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ABSTRACT 


Three  dimensional  Images*  similar  to  depth  maps*  are  obtained  with  a 
tr  1  anBu  I  *t  I  on  system  using  a  television  camera#  an<*  a  deflected1® 
laser  beam  diverged  Into  a  plana  by  a  cylindrical  lens* 

Complex  objects  are  represented  as  structures  Joining  parts  called 
generalized  cylinders,  These  Primitives  ae  formalized  In  a  volume 
reoresentat  I  on  by  an  arbitrary  cross  section  varying  along  a  soaoe 
curve  axis,  Severa|  types  of  Joint  structures  «r*  discussed. 

Excerlmantel  results  ar«  shown  for  the  description  (building  of 
Internal  computer  models)  of  a  handful  of  complex  objects*  beginning 
with  laser  range  data  from  actual  objacts*  Our  programs  have 
generated  complete  descriptions  of  rings*  cones*  and  snake- 1 1 ke 
objects*  all  of  whhlch  may  be  described  by  a  single  primitive. 
Complex  objects*  such  as  dolls*  have  been  segmented  Into  parts*  most 
of  which  ar*  well  described  by  programs  which  Implement  generalized 
cy  I  lnder  descriptions. 


This  r*searoh  was  supported  In  part  by  the  Advanced  Research  Projects 
Agency  of  the  Office  of  the  Secretary  of  Defense  under  Contract  No. 
SO-183* 

The  v|*ws  and  conclusions  contained  In  this  document  are  those  of  the 
author  and  should  not  be  Interpreted  as  necessarily  representing  the 
official  policies,  either  expressed  or  Implied,  of  the  Advanced 
Research  Projects  Agency  or  the  U.S,  Government. 

Reproduced  In  the  USA,  Available  from  the  National  Technical 
Information  Service*  Springfield*  Virginia  22151,  Price!  full  size 
copy  S3.00J  mlcrofIche  copy  S3, 95. 


acknowledgements 


I  would  like  to  express  my.aD5reclatl9n.for  the,  outdance  and 
assistance  of  my  advisor,  Or.  Thomas  0,  Blnford,  His  TnsTght  has 
been  helpful  on  many  oocastons.  Many  of  the  original  ideas  on 
which  this  research  Is  based  were  his,  Including  generalized 
tr»ns | at  I ona I  Invariance,  and  the  basfc  configuration  of  a  laser 
ranging  system, 


The  Internationa!  Business  Machines  Corporation  has  sucDorted 
nre  and  my  family  during  my  three  years  at  Stanford,  without 
their  aid  the  rewarding  exDerlenea  of  attending  school  and 
oorsuing  a  doctoral  oroOram  would  have  been  extremely  difficult, 
If  not  Impossible, 

Thanks  are  also  due  to  Dr,  Arthur  l.  Schaw|ow  for  the 
fienerous  loan  of  a  laser,  to  victor  schatnman  for  the  design  and 
assembly  of  the  laser  deflection  apparatus,  to  Richard  Underwood 
for  routines  for  the  numerical  solution  of  the  generalized 
eigenvalue  equation,  and  to  Bruce  g,  Baumgarti  R.  K,  Nevatia,  and 
J,  M,  Tenenbaum  for  their  helpful  comments  and  suggestions. 


TABLE  of  CONTENTS 


1  INTRODUCTION 


Page  i 


2  KEPR£SENTAT I  ON 

2.1  Requirements  for  a  RebResentation 

2.2  A  HIERARCHICAL  VOLUME  REPRESENTATION 

2.3  generalized  translational  invariance 

and  GENERALIZED  CYLINDERS 

2.4  COMPARISON  with  SOME  OTHER  METHODS  OF 

REPRESENTATION 


Pag* 

Pag* 


3 

4 


Page  5 


PaPe  12 
Pag*  18 


3  DEPTH  measurement  Pag#  23 

3.1  SOME  METHODS  OF  DEPTH  MEASUREMENT  Page  23 

3.2  TRIANGULATION  BY  LASER  Page  24 

3.3  HARDWARE  Page  28 

3.4  CALIBRATION  Page  33 


4  PRELIMINARY  PROCESSING  and  curve  FITTING 

4.1  LINE  EXTRACTION 

4.2  LINKING  THE  POINTS 

4.3  RECURSIVE  SEGMENTATION 

4.4  CURVE  FITTING  SUBROUTINES 


5  F1TT,l?l°FC?2l»ifiV^ACIN= 

5.2  EXTENDING  THE  CYLINDER 

5.3  PRELIMINARY  GROUPING 

5.4  LOCATING  CROSS  SECTION  POINTS 

5.5  RADIUS  AND  CENTER  ESTIMATION 

5.6  SOME  RESULTS 


6  DESCRIPTION  OF  ORJECIS 

6.1  LINKING  SEGMENTS  TOGETHER  INTO  A  SKELETON 

6.2  DEALING  WITH  NON-CIRCULAR  CROSS  SECTIONS 

6.3  SEPARATION  OF  OBJECTS  IN  A  SCENE 

6.4  OCCLUSION 

6.5  RECOGNITION  OF  OBJECTS 


7  conclusions 

7.1  ADVANTAGES  OF  ACTIVE  RANG I NG 

7.2  WHe;R£  qO  »£  GO  FROM  HeR£? 


Page  101 
page  101 
Page  104 


CONTENTS 


APPENDIX  A: 

APPENDIX  B: 

B,1 

3.2 

3.3 

B,4 

B,5 
B ,  6 

REFERENCES 


ERROR  ANALYSIS  OF  RANGING  SYSTEM 


Page  106 


CURVE  FITTING 

fitting  of  general  second-order  CURVES 

SOLUTION  OF  THE  GENERALIZED 

EIGENVALUE  EQUATION 
FITTING  OF  STRAIGHT  lines 
ROTATIONAL#  TRANSLATIONAL,  and 

scaling  invariance  of  eigenvector  solution 

the  CURVATURE  PROBLEM 

ALTERNATIVES  to  general  SECOND-ORDER  CURVES 


Page 

Page 

Pag« 

Page 


P£ge 

Pag* 

Page 


111 

111 

115 

118 

120 

125 

129 


Page  132 


I  v 


1  INTRODUCTION 


Our  present  interest  in  representation  and  description  of 
eurvea  objects  arose  from  desire  to  extend  the  capabilities  of 
the  Stanford  Hand-Eye  System  CFejdman]*  to  recognise  a  wide? 
class  of  objects  than  o I ane-bounded  solids.  Our  I n 1 1 1  a  I _ attempts 
to  recognize  cones*  cylinders,  and  spheres  were  not  carried  fa? 
enough  to  demonstrate  the  usefulness  of  existing  technlaues  In 
recognizing  thls  limited  addition  to  the  class  of  recognizable 
objects,  But  there  appears  te  be  no  Insurmountable  barrier  to 
doing  so, 


Ther*  have  been  few  other  attempts  to  recognize  curved 
objects,  B.  K,  P,  Horn  [Horn]  reconstructed  the  depth  contours 
of  three  dimensional  surfaces  from  their  photographs,  based  on 
assumptions  about  the  light  reflection  character letlcs  of  the 
surface,  Krakauer  CKrakauerJ  was  able  to  distinguish  amono 
several  kinds  of  fruit  by  examining  the  connectivity  and 
structure  of  brightness  contours  In  a  two-dimensional  Image, 

It  soon  became  apparent  that  little  useful  purpose  would  be 
served  by  these  techniques,  A  significant  Imorovfment  In 
Derformance  of  vision  systems  would  come  only  when  theywere 
caoabie  of  recognizing  the  sort  of  everyday  objects  that  a  robot 
of  the  future  might  have  to  deal  with.  To  accomplish  this,  w* 
make  use  of  two  ngw  tools  or  techniques, 


„  !!?•  first  of  these..  Is. a  r ep?esentat  1 0°  8#ni7;*.L  and-flexlble 
enoush  to  carry  varied  Information  about  an  object,  its. Darts, 

and  their  relation  t.o  one  another.  The  representation  we  propose 
w| i 1  allow  several  different  models  for  Primitives  or  parts  of 
objects,  These  models  may  Inolude  Prototypes  of  var  lous. sorts', 
The  Particular  prototypes  we  emoloy,  generalized  cylinders,  are 
useful  for  describing  a  large  class  of  natural  and  man-made 
objects,  Generalized  cylinders  consist  of  a  soace  curve  or  axis 
and  a  set  of  cross  sections  described  on  this  axTs,  yhey 
describe  In  a  natural  and  Intuitive  way  pieces  which  possess 
elongation,  or  which  have  axial  symmetry.  The  generalized 
cylinders  may  be  jinked  together  In  various  ways  to  form  complex 
objects.  The  most  significant  departure  from  previous  methods  of 
deecrlotlon  Is  that  the  representet I  on  Is  essentially  a  volume 
representation,  as  oD^osed  te  a  surface  r*cresentat Ion,  Chapter 
2  of  this  report  describes  In  detail  representation  by 
generalized  cylinders#  and  gives  some  examples  of  how  objects 
might  be  modelled  with  such  a  representation. 


•  Names  |n  sauar*  bracxets  denote  references  which  may  be 
foynd  at  the  end  of  this  report. 
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2  REPRESENTATION 


u  fundaments !  problem  tn  the  design  of  intelligent  machine* 
ano  cimSStlr  taoro5?ami  Is  caBttSIOtliiBO.  Problem  solving 
reoulr«s  facts  ab0ut  tn®  Dro^i^m  bgmat,-i.  ^ni^  a  f'n  t*  ounb  [  ®- 
faets  may  be  stoperi  directly  In  a  machine's  memoryl  other 
Information  whlcn  the  machine  reoulres  must  oe  deduced  or 
Inferred  from  the  available  data,  Wi  shall  address  ourselves 
specifically  to  Information  about  solid,  three  dimensional 
opjects,  The  question  which  must  be  answered  In  the  preliminary 
deslfin  stage  of  a0  Intelligent  machine  Is, then,  what  types  of 
data  will  be  stored,  and  ho*  should  It  be  organized  in  order  to 
obtain  other  useful  Information? 


Frequently#  Problem 
series  of  transformations 
the  same  data,  For  the 
at°ut  the  external  world 
th*  raw  Input  from  the 
decisions  may  be  baaed, 
th«  process  of  deriving 
level  data,  We  may  also 
deecr Iptton, 


solving  requires  a  transformation  o?  R 
between  different  ways  of  representina 
robot  whioh  must  acaulr®  Information 
through  sensors,  this  means  going  from 
sensors  Into  a  set  of  facts  upon  which 
We  use  th«  word  dfiacclfitiOD  to  denote 
a  high  level  representation  from  low 
c&ll  the  data  structure  so  derived  a 


Representation  and  description  are  intimate  y  »‘*i»ted.  The 
form  of  the  representation  dictates  the  description  strategy.  A 
u3efu|  representation  makes  description  easy,  But  a  useful 
representation  must  also  Provide  ways  of  dealing  with  and 
manipulating  Its  dtscr lotions,  It  must  Provide  us  with  the  kind* 
of  Information  we  really  want  for  decision  making,  Intelligent 
machines  w|l|  utilize  this  Information  for  recognition  and 
classification,  for  manipulation  by  external  machinery#  foreman- 
machine  corrmun j catl on#  and  for  graphical  display  or  drawings. 
Section  2.1  soejis  out  some  desirable  characteristics  or  a 
representation  for  decision  making, 

M.d.7jny«?I’5K  lStSi,,»?r*8?TSttl?!!  i?voiSte«h,dS!!ri?t!8S|,i?J 

composed,  Usually  the  models  themselves  Possess  some  structure 
of  thelr  own,  Ds5cfloti°ns  ar®  buHt  up  by  specifying the 
relationships  between  Primitives,  Specifying  a  rooresentat I  on 
involves  a  choice  of  what  models  to  make  use  of,  and  how, they  are 
to  be  interrelated,  m  section  2.2  we  outline  the  structure  of  a 
r.ew  rtpr*sant3*  I  op  making  us*  of  3fiQ2£iil2fid  fiyllodics  and  ot  r 
ffoOeis.  Generajlzed  cyjln^ers  are  treated  In  Section  2.3, 


3 


2 


representation 


Other  representations  have  been  used  and  are  being  used  In 
I  r.te  i  l  I  gent  machines  foP  desCr  i^tng  soil0  objects.  In  Section 

2,4  vhq  compare  some  of  these  with  representat 1  on  by  generalized 
cylincprs,  ana  explain  haw  they  fall  to  meet  the  retirements  we 
have  set  forth, 


2.1  REQUIREMENTS  FOR  A  REPRESENTATION 


a  general  purpose  Intelligent  machine  should  bej  capable  of 
dealing  with  a  wide  variety  of  Information,  Specifically.  >  t- 

should  be  able  to  recognize  and  manipulate  a  wide  class  of 
°bJect.,  asse  the  _  i  m  I  I  a  r !  ty  betw*ah  t«°  °r  rnore  ot-ects*  ana 
deter rnTne  tne  relationships  among  objects  within  Its  universe. 
To  assign  such  a  machine.  It  is  nacassery  to  develop 
concepts  of  the  ''shape*'  of  a  three-dimensional  object. 


some 


.c.ctMg$'?BSy»a33?rISS!5r.!,ofs2SD8oji§t,  SASasaael*j0,?fi^i5Vi; 

and  minor  details  are  related.  Soma  other  Important  attributes 
of  shape  are  topological  connectedness.  elongation,  |sngth»to. 
w|dth  ratios.  Dresenoe  and  orientation  of  edge*,  and  symmetry. 


Ar  aaeauate  representation  of  shaoe  should  be  caoabje  of 
sesmertlng  an  object  Into  parts.  Parts  may  be  described 
Independently,  then  the  relationship  of  the  parts  may  be 
specified  to  form  objects,  Segmentation  Is  essential  in  the 
description  of  complex  objects,  It  allows  a  small  number  of 
baalc  parts  to  b«  linked  In  a  large  variety  of  ways.  The 
structure  of  a  complex  object  Is  then  contained  In  the 
relationships  b«tween  parts,  If  the  segmentation  js  done 
oroperly,  the  parts  will  possess  simpler  descriptions  than  the 
object  would  without  segmentation,  When  the  Darts  may  be  further 
segmented  Into  sub"parts,  a  hierarchical  representation  le 
obtained, 


A  hierarchical  representation  also  allows  a  variaole  degree 
of  detail  to  be  studied,  Detailed  information  should  be 
available  for  comoarison  between  objects  which  are  nearly  alike, 
but  this  detailed  Information  should  not  be  allowed  tc  hide  the 
re  I avent  structural  Information  when  the  detailed  Information  is 
■j  n  n  e  e  o  e  d , 

Yet  a  hierarchical  Organization  aoes  not  comoletely  solve  the 
Problem  of  making  available  a  variable  degree  of  Octal  I  ,  In 
general,  some  redundant  information  must  be  stored  Co r 
generated),  A  siven  Dart  might  contain  several  descr ! otlons , 


REQUIREMENTS  FOR  A  representation 


2.1 


successive  acpro*inat Ions  giving  Greater  and  greater  precision* 
The  flrosser  descriptions  wl I  I  not  contain  as  much  Information  an 
the  finer  ones,  s°  ths  additional  storage  to  Keep  the  grosser 
on*s  will  not  be  great. 

Comparison  between  objects  must  be  allowed,  and  the  degree  of 
similarity  assessed.  Comparison  should  be  on  the  basis  of 
structural  similarity  first,  and  tnen  on  degree  of  similarity 
between  parts  of  the  structure. 

Many  natural  and  manufactured  objects  possess  elongation. 
Most  higher  orders  of  life  are  distinguished  by  theTr  extremities 
l*fls,  arms,  heads,  stems,  and  branches,  The  shaoe  of  man-made 
objects  are  freauently  dictated  oy  the  shaoe  of  their  raw 
materials,  their  method  of  manufacture,  af>d  their  function,  And 
whore  elongation  Is  present,  the  direction  of  the  elongation 
usually  bears  seme  useful  or  functional  relationship  to  the 
object  as  a  who'e, 


2,2  A  HIERARCHICAL  VOLUME  REPRESENTATION 

, Present  here  a  hierarchical  representation,  which  we 
believe  to  contain  most  of  the  desirable  features  set  forth  In 
the  preceding  Section,  The  representation  is  essentially  a 
volum*  representation,  which  makes  use  of  armltke  Primitives,  and 
builds  descriptions  by  relating  the  Primitives  and  thelr4  axes  jn 
various  ways,  The  orlmltlves  art  called  geoacalizEd  cyllDdflts. 
which  ftra  eapat>je  0f  de9Crib|ng  "snakes«  0f  arbitrary  Cross 
section.  The  representation  may  be  extended  by  the  addition  of 
other  Primitives. 


f.°r!8:St.??on?u5iUsS  A2o.fi?!?  w??tD*!5.i'*«oh  ofrim°S6j.Sf{ 

with  which  a  robot  might  have  to  deal.  Only  a  small  subset  of 
the  r-eoresentat  I  on  has  actually  been  Implemented  In  our  orograms 
and  experimental  work, 

,trufe?SfS?  ?n?ijmS?lon,IIf,^ncoSY"».§?lAlSUAStleKTh?:?u?2'l'Il|ucS 

»s  I*  anown  In  Figure  2,1,  The  six  main  parts  which  make  up  the 
figure  (the  body,  two  legs,  two  arms,  and  the  head)  are 
reDr*sented  03  lines  or  axes,  The  structure  which  the  exes  make 
up  we  Ca||  the  skgliiflQ  of  the  object,  The  structure  of  the 
figure  Is  apparent  from  the  way  these  axes  are  related,  Most 
People  would  have  little  difficulty  recognizing  the  figure  as 
representing  a  man, 


2,2 


A  H I CAL  VOLUME  REPRESENTATION 


The  line  represent i ng  the  body  Is  drawn  broader  than  the 
Unes  0f  the  other  parts,  'we  denote  that  line  as  the  atloclpil 
axis  o f  the  figure.  The  0th|r  axes  j0!n  t0  the  Drlncipa|  axis,. 
and  a r e  r«Dr«sented  as  syfigcSlpill  **fia.  A  D r i nc I Da |  axis  is  not 
always  definable  in  an  arbitrary  object  or  Dart#  but  when  it  can 
be  defined#  It  serves  to  Provide  emphasis  to  a  description. 

w@  daoend  oo  segmentation  to  olvide  the  picture  ln*o  piece* 
*hicn  may  pe  simply  represented,  If  desired,  each  part  may  be 
further  segmented  Into  smaller  pieces  to  show  a  greater  degree  of 
detail,  Figure  2,2  shows  “ow  we  might  represent  the  aPm  of  th» 
Stic*  figure,  The  upper  arm  and  the  forearm  constitute  th# 
Principal  axis  of  the  ar.'fl.  The  logs  may  be  similarly  segmented 
a  r.  o  represented. 


what  the  lines  of  the  figure  actually  represent  are  solid 
oiurres,  we  represent  the  volume  ty  a  cross  section  function  on 
h«  axis,  A  screwdriver  may  be  represented  by  a  simple  straight. 
I  he  skeleton,  with  a  cross  section  function  such  as  that 
r.dlcated  In  Figure  2,3,  A  formal  description  of  how  volumes  art 
eherated  within  our  description  follows  in  the  next  Section, 
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H 1 tR ARCH  I  CAL  VOLUME  REPRESENTATION 


Figure  2,2 

Stick  Figure  of  an  Arm 


Figure  2,3 

ReDresentat I  on  of  a  ccrewdplver 
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A  HIERARCHICAL  VOLUME  REP^ETEf-TAT ! ON 


a  I  though  we  r3Pr®sant  volumes,  for  a  structural  description 
It  is  convenient  to  find  the  center  lines  of  elongated,  carts  and 
refer  to  these  Instead  of  to  the  more  complicated  descrictions  of 
the  vciu-nes  themselves,  These  axes  may  he  arbitrary  space  curve* 
! n  three  dimensions,  as  dictated  by  the  volumes  they  represent, 

The  places  where  axis  segments  meet  we  call  joints,  Joints 
aro  oescPlbed  ay  the  nUmbeP  0f  parts  being  joined,  the 
Orientations  of  the  of  the  segments,  whlch  of  the  segments 
contains  the  principal  axis  of  the  assemoiy,  and  whether  the 
Joint  is  fixed  or  movaole, 


J<j?  |  nts 


ti£ 


we  call  act-- 
a  tiaSi  Joint 


..  whlch 
culated, 
ti  whl< 


one  part  may 
Three  common 


mg  ye  .with 


jh|( other 


nds  of  articulated  Joint  are 

- -  .  ch  a | | ow5  i  a  t e  r 3  |  notion. 'n  one  d'm’ns'on*  a 

2a++:andcseCh9t  Jolpt»  which  a(|0ws  ,atefa|  motion  |n  tw0 
a|menslonsi  and  a  rgtatiDS  JoiDI,  In  wnlch  rotational  notion  of 
one  cart  w*th  r®so®ct  to  the  o*her  |«  allowed,  The  most.3®ne-ai 
tyoe  of  joint  Is  both  a  ball-and-socket  Joint  and  a  rotati 
Joint, 


no 


The  data  structure  of  oup  reores8ntat  1  on  wl|[  account,  for  a 
general  type  of  Joint  Dy  storing  the  appropriate  Information 
about  eaoh  part  comprising  the  jclnt.  But  there  are  exactly 
three  types  of  joint  which  recur  so  freauentiy  that  we  oive  them 
special  names, 

The  slmolest  type  of  joint  joins  two  parts  SDa-tQriod.  .This 
tyoe  of  Joint  is  best  exemplified  hy  an  elbow,  as  shown  Tn  Figure 
2,4,  The  prlnclDal  axis  of  the  assembly  contains  the  principal 
axes  of  both  certs,  although  almost  every  end-to-end  Joint  could 
be  eliminated  oy  describing  the  two  Darts  together  as  a  single 
generalized  cyilnaer,  ths  end-to-ond  joints  are  useful  where 
there  is  a  discontinuity  In  cross  section,  a  sharp  bend  or  change 
lr  curvature  of  the  axis,  cr  a  movable  connection, 


The  second  common  type  of  joint  occurs  when  the  end  of  one 
Dart  Joins  the  middle  of  another,  We  call  the  first  part  the 
crossbar,  the  second  the  upright,  and  tne  connection  a  Isjaioi, 
The  thumb  0f  Figure  2,5  Is  a  g0od  eXamD|e*  The  princica|  aX'S  0f 
the  assembly  generally  follows  the  crossbar,  Usually  the  cross 
section  of  the  uDrlght  (perpendicular  to  the  Plane  of  the  T)  will 
not  exceed  the  cross  section  of  the  crossbar. 

The  third  tyoe  of  Joint,  which  we  call  a  bii yccailon,  occur* 
»h«n  one  oart  meets  (or  dlvldes  i^o)  two  subordinate  carts,  A 
good  example  Is  found  where  the  thighs  meet  the  hips,  The 
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suboro I nate  branches  ape  approximately  d a p a  |  i e l  to  each  otn9r  end 
to  the  principal  branch,  A  conservation  of  cross  section  hold* 
a+  a  clfurcation*  the  cross  sections  of  tne  subordinate  tranches, 
together#  should  roughly  eoual  toe  cross  section  of  the  principal 
brancn,  Sometimes  +he  Principal  part  will  divide  Into  .-ore  than 
t*c  subordinate  brancnesj  In  this  case  we  call  the  Joint  a 
lultiiUcCatiQD i  F i Jure  2,5  also  contains  an  example  of  a 

mu  I t ' f  ur  cat i on . 

Tnc  degcrlotjon  process  may  oe  likened  to  cutting  and 
oas t 1 nfl ,  The  Image  of  an  object  Is  cut  into  Darts  whicn  may  be 
described  as  generalized  cylinders.  Holes,  notenes,  and 
concavities  are  cut  out  from  tha  primitives.  The  eastinc 
operation  will  out  the  pieces  together  into  a  framework  which 
describes  the  structure  of  the  ooject, 

* 

Our  representation  Is  non-un 1 aue ,  Segmentation  is. carried 
cut  or  the  basis  o*  what  results  in  the  simplest  description,  and 
depends  on  heuristic  choices  of  slmcllcity  and  I  o  c  a  ]  models, 
Routines  which  compare  descriptions  of  opjects  must  therefore 
take  Into  account  the  various  ways  which  segmentation  might  be 
»oc  Mad, 

Figure  2.6  snnws  two  different  ways  In  which  a  disk  may  be 
represented.  Tnls  illustrates  the  Importance  of  symmetry. in 
selecting  an  axis,  jf  we  use  elongation  as  the  sole  criterion 
for  determining  the  direction  of  the  skeleton,  the  representation 
on  the  left  of  Figure  2,6  Is  obtained,  Clearly  the 
representation  on  the  right  Is  Preferable,  since  ax}a|  symmetry 
allots  a  simpler  description, 

a  shallow  dish  or  dow|  is  more  Difficult  to,  represent,  since 
If  t^e  axis  of  symmetry  is  to  oe  the  skeleton  of  the  object,  then 
the  c.-oss  section  Is  not  a  simple  curve.  The  use  of  a  hollow, 
th.ln-waileo  cress  section,  w  I  I  I  provide  a  slnple  reoreaentat  i  on 
In  th I s  cage , 

Generalized  cylinders  are  not  capable  of  representing 
concisely  »n  arbitrary  degree  of  deta'I,  A  hierarchical  aDproech 
can  Improve  the  level  of  detail  t"o  which  objects  can  be 
represented,  but  beyond  a  certain  ocint  the  simplicity  of  the 
metnoc  Is  lost,  It  would  certainly  oe  possible  to  generate  a 
nurran  face  with  generalized  cylinders,  but  to  describe  a  face  to 
the  level  of  detail  necessary  to  distinguish  one  face  from 
another  would  exceed  the  limits  of  practicality. 
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figure  2,6 

Two  Representations  of  a  Disk 


nz&:  «:«' .  rI  s :  .  s 

ejl‘noo°i.  bit  wo  may  taka  a  llttlf  tl",  to  ,u«g.,t  what  oth., 
Dr  1  m  1 1 1  v  •  a  might  be  helpful, 


5?  1  ■?? I V*  oonsl s*l ns  of  Mat  ohooto.  »  strictly 
ricras.ntatton  o*  Jhooto  will  not  oa  usafwl  bacausa  U  cannot 
««u!t  »or  bondlno  or  warolno  of  tbo  ohooto,  Hat  ahaats  •• 
represented  In  a  manner  similar  to  the  way  we  ifl0d*1 
cylinder*#  except  that  the  cross  sections  beoome  pne-dlmensional . 


.i..KftlS**.8t,mSr^lK  ISiuS?S,?“"cSRSSvi??iS;'TS’gS3.cSi^ 

Truncating  olane,  and  surfaoesw|ll  be  useful  In  descrlblno 
hBm| scheree  and  the  like,  These  are  a  specla 
subtractive  vo|ume£  wnere  only  one  surface 
volume  need  be  described, 


of 


case  of  a 
the  truncatlnq 
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The  strer*9th  of  t"  1 3  method  of  reDresentat  I  on  lies  In 
segmentation  which  results  In  simple  descriptions  of  the  major 
features  and  prooortlons  of  nan- made  ana  natural  shapes!  and  in 
the  usefulness  of  the  descriptors  In  inferring  shaoe^  and 
function,  The  segmentation  depends  on  a  class  of  primitives 
which  allows  a  natu.al  oart-wnole  decomposition  and  which 
suggests  simple  apofox I  mat  I o^s , 


2,3  GENERALIZED  TcA!<SLaT I ONAL  IMVaRIANCE 
AND  GENERALIZED  CYLINDERS 

To  describe  the  snakelike  primitives  of  our  system,  we  make 
us«  of  the  concept  of  generalized  trans I  at  1 ona l  invariance,  first 
formalized  by  T,  0,  Sinford  CBlnford  712,  and  extended  here. 

The  model  we  orooose  consists  of! 

1,  A  space  curve,  called  the  axis, 

2,  P|apes  perpendicular  to  the  axis,  and  a  set  of 
axes  on  the  Diane, 

3,  a  variable  cross  section  described  on  these  axes, 

These  Primitives  we  call  gsDScal-Ufifi  CtfllodSrs, 

a  simple  cylinder  may  be  generatedas  follows?  Suppose  there 
Is  an  arbitrary  simple  closed  curve  lying  in  an  arbitrary  plane, 
a$  shown  In  Figure  2,7,  If  the  olane  is  translated  In  * 
direction  normal  to  the  plane,  the  locus  of  the  curve  trace?  out 
a  Portion  of  a  surface,  The  surface  so  traced  is  a  cylinder  (in 
the  usual  geometric  sense  of  the  word),  With  suitable 
terminating  surfaces  at  the  ends,  this  Process  can  generate  a 
soIIp  Dody  enclosed  by  the  surface, 

We  can  formalize  the  generation  of  simple  cylinders  as 

«* 

follows?  Let  C  denote  the  curve,  P  the  plane  In  which  it 

*  *4 

Initially  lies,  andp  the  direction  normal  to  P,  Let  T(o,d)  be  a 
translation  operator  which  we  may  apply  to  space  curves,  such 

«e 

that  T(Diq)*c  represents  the  curve  C  after  It  has  been  translated 

4  «♦ 

a  distance  a  In  the  direction  0 ,  The  vol ume  T (0, s)*C  ( Z<$£X) , 
the  locus  of  the  area  Inside  C  as  It  is  translated  a  distance  X 
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2.3 


F ! gur  *  2*7 
A  Cy I Inder 


4 

In  th#  direction  no»ma|  to  P,  Is  a  cylinder.  If  D  Is  soma 

4 

distinguished  point  on  P  assoclatad  with  C  (such  as  tha  center) 

4 

than  T ( p  *  3 ) *0  <03sSX)  pappasants  a  stpalght  line  In  aoaca  which 
w a  ca||  tha  "axis”  of  the  volume, 

,  w«  genapal  Ize  thl»  "simple"  cylinder  In  two  ways.  The  first 
Is  to  allow  the  direction  of  translation  to  vary.  The  second  Is 
to  allow  the  shape  of  the  cposs  section  to  vapy, 

Generalized  .translational  Invariance,  as  formulated  ,by 
Blnfopd,  generalizes  both  the  translation  and  the  cross  section 
variation  by  Including  In  the  operator  T  a  congruence 
transformation  on  cross  sections,  That  Is,  th*  operator  will 
transform  the  translated  cross  section  to  force  a  congruence  with 
th*  normal  cross  section  at  tha  translated  position,  This  Is 
basically  a  descriptive  taohnlcua  which  will  be  useful  I?  wa  can 
find  an  axis  choice  such  that  th*  congruence  transformations  ar* 
sufficiently  slmcie,  It  Is  this  technlau*  which  w*  follow  In  the 
computer  description  of  primitives  »et  forth  In  Chapter  5*.  But 
for  a  higher  level  representation  of  como lex  objects  we  prefer 
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I 

th*  generational  technlsue  which  follows,  We  believe  that  the 
seoaration  of  the  axls  and  the  cross  sectl°n  descrlot!ons  Qives  a 
.  Tore  genera!  and  more  Intuitive  recresentat Ion  of  shaaa, 

jjj  Allowing  the  direction  of  translation  to  vary  wt||  allow  us 

I  to  Generate  "snakes"  of  constant  cross  section,  aa  shown  in 

■  Eigjre  2,8,  In  our  computer- I mp I  evented  representation,  the  axis 

J  Is  represented  as  a  seauence  of  oolnts.  But  In  general,  we  wish 

to  Oescrlbe  the  axes  as  continuous  SDace  curves,  nq  choose 
helices  to  represent  space  curves  of  constant  curvaturoj  if  the 
cprvatur3  of  a  curve  varies,  It  may  oe  approximated  by  a  seauence 
'  of  segments  cf  the  probSr  curvature. 


Figure  2,8 

Ganeral|zen  Cylinder  with  Cong+ant  C'03s  Section 


To  describe  nejlcal  axes,  it  is  convenient  te  Introduce  an 
auxiliary  coordinate  system,  a,  centered  on  the  d i st^ngul shod 

* 

oolnt,  0,  The  curvature  of  the  axis  will  pe  described  relative 
to  tMs  coordinate  system,  yhe  direction  of  translation  will  d* 

the  z-axls  of  A,  The  curve  C  lies  in  the  x-y  Diane  of  A,  The 

orientation  of  a  with  respect  to  the  rest  of  the  wor'd  will  be 

some  function  of  arc  length,  s,  along  the  axis,  That  Is,  the 

orientations  of  th*  x-»  y-  and  z-axes  of  A  are  the  (mutually 
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*  *4 

orthoganti)  vector-valued  functions  x(s).  y(s),  and  Z(s),  An 
* 

axis  DCs)  may  be  represented  as  tha  solution  to  the  difference 
*  * 

«auatlon  0  *  T  *  0  ,  or 


D< s+ds)  c  T(z(s)»ds)  *  D(s> 

In  tn*  limit  as  d$  aDproaohes  (?,  Or  aou !  va  I  ent  |y, 


CEouatlon  2,13 


dD( s J/ds  =  Z(s). 


CEauation  2.23 


If  wa  represent  the  curve  C  parametrically  In  the  x-y  plane  of. A 
(although  we  w I | 1  not  necessarily  depend  on  a  oarametrle 
representation)  w*  might  ohoosa  the  form 


x*f  [t),  y*f  (t)#  (BStSt  ) 
x  y  max 

*h«re  t  Is  arc  length  along  the  curve.  Than  the  surface  C(sit) 
may  ha  represented  Tn  three  dimensions  as 

C(s.t)  *  D(s)  ♦  f  (t)  x<s)  ♦  f  (t)  y(s),  (0<t£t  .). 

x  y  max 

CEauation  2.33 

Tha  "generalized  cylinder”  Is  bounded  by  the  locus  of  CCs>  as  s 
varies  from  0  to  X. 

Three  Indeoendfet  derivatives  are  necessary  to  describe  the 
motion  of  0  end  Its  coordinate  system,  (CCovet*r3  contains  a 
discussion  of  the  generation  of  helices,)  we  ohoo.se  tcrsion*  T 
(t*u),  curvature  K  (RaDDa)  ,  and  an  angle  9  (tneta>  denotlngan 
axis  of  ourvature  In  the  x-y  plane,  such  that  the  following 
relationships  hold: 


dx/ds  *  -K  z  cos  9  *  7  y 
*  * 

dy/ds  «  -K  z  sin  9  -  T  x 

«e  *  4 

dz/ds  s  K  (  x  cos  9  +  y  sin  8  ) 
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CEauation  2.43 
CEauation  2,53 
CEauation  2,63 


> 


n9ui*e  2.5  jhowg  a  helical  skeleton  and  a  peometrip 
interpretation  of  torsion  and  curvature  for  the  case  where  8  «  0 , 
Pure  torsion  results  In  rotation  of  A  about  Its  z-*x  I  s  Pure 
curvature  results  In  rotation  of  A  about  the  axis  of  curvature. 


Only  an  Initial  Dosltlcn  and  orientation  for  the  auxiliary 
coordinate  system  a,  olus  our  th*ee  derivative  parameters,  are 
necessary  for  EoUatfons  2,«  through  2,6  to  generate  space  curves 
*hlch  are  segments  of  arbitrary  helices,  Jf  T  Is  zero,  a  torus 
Is  generated,  If  k  Is  zero,  the  eouatlons  generate  a  straight. 
Mne, 


»c..TBf.  l§ri§Sif,y»  (ft.  6?fVB?ISIon‘Sf -SAl  Ismlifi8? 

systeir  a  such  tha$  the  center  of  curvature  always  lies  T 
Diane,  The  additional  variaole  allows  us  to  specify 
section  shapes  mere  economically, 


5ordl?iall 
5  the  x-z 
the  cross 


The  second  way  we  generalize  our  formal  model  Is  to  allow  the 
shape  of  the  cross  section  to  vary,  Let  C(s)  be  a  cross  section- 
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v'aiu^a  function  of  9.  That  1  s «  given  some  specific  value  for  s, 
the  function  C(s>  will  tell  us  how  to  construct  a  closed  curve 
^or  a  family  of  non- 1 ntir sect  I ng  closed  curves)  on  the  x-y  olane 
of  a «  In  specifying  the  form  of  C{s),  we  have  chosen  to  use  a 
small  s«t  of  regular  geometric  shapes*  with  variable  scalar 
Parameters  to  soee  I  f y  site,  proportions*  Or  rotation.  These 
Parameters  may  be  functions  of  arc  length  s  along  the  avis*  so 
that  we  may  generate  cones,  drills#  or  piano  legs, 

Representation  of  cross  section  shacts  has  not  been  the 
attention  it  de$erves  In  this  research,  Describing  cross 
sections  fa  a  representation  problem  |n  two  dimensions,  and  many 
of  the  comments  w$  nave  already  offered  on  representation  might 
o«  applied  her«_  as  well.  In  particular*  segmentation  Is 
Important  In  describing  complicated  cross  sections,  Our  forma) 
moael  Is  capable  of  extension  by  the  addition  of  other  means  of 
specifying  cross  section  curves.  Polar  functions  (radius  vs, 
anfl|e)  and  other  parametric  representations  of  the  cross  section 
outline  can  provide  a  very  general  descriptive  power,  gut  these 
aft  pot  entirely  satisfactory  since  th«lr  construots  do  not. 
Provlae  an  Intuitive  description  of  shape. 


anomaly  arises  when  the  axis  of  a  cylinder  curve*  with  a 
radius  of  eurvature  |es3  th^n  the  ” lnslde»_radlus  of  the  cross 
section.  Such  a  situation  Is  Illustrated  in  Figure  2 "•  l CJ •  Th# 
auclsci  described  py  the  cross  section's  outline  Is  convojute. 
But  the  ygluEfl  of  the  *olld  Is  the  locus  of  the  lnt®rlo?.  of  the 
Cross  section#  The  fact  that  this  |ocus  Crosses  Itself  sh0U|d 
Introduce  no  difficulty,  The  surface  of  the  object  In  the 
v|c|n|ty  of  the  bend  will  be  those  Dolnts  of  the  object  which  are 
adjacent  to  Its  exterior. 


with  a  sufficiently  general  cross  section  representation, 
generalized  translational  Invariance  w I | I  genfrata  any  realizable 
objact,  In  a  trivial  but  uninteresting  way,  Let  the  axis  ba  a 
straight  line,  and  describe  the  cross  sections  cut  by. plans* 
Darpend 1 cu I ar  to  the  axis  as  a  function  of  langth  along  It.  Th* 
description  of  these  cross  sections  w|||  net,  In  genera),  ba  easy 
or  elegant.  The  utility  of  the  method  of  description  win  lie  In 
It*  simplicity  »nd  Its  usefulness  In  extracting  significant, 
features,  The  fundamental  auestion  Is  whether  we  can  do  thl* 
simply  for  an  Interesting  class  of  objects, 
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Figure  2.13 
Surface  Anomaly 


2,4  COMPARISON  WITH  SOME  OTHER  METHODS  OF 
representation 

Many  ways  o'  representing  three-dimensional  obj«-ts  exist. 
Different  representations  make  different  kinds  of  information 
tvallaele,  and  achieve  different  degrees  of  success  In  presenting 
this  Information  ]n  a  useful  manner,  We  snail  mention  some  of 
the  more  significant  of  these#  and  compare  them  with 
representation  by  general Ized  cylinders  with  rescect  to  how  well 
they  describe  those  attributes  we  call  shape. 


Among  the 

tne  soace 


_  ..  most  basic  methods  of  representing  solid  objects 
op*  the  aoace  mao  and  the  BiCtb  sas.  A  soace  map  is  a  three- 
0 1  m*ne  '  on#  |  array  Cnr resp0nd ! ng  t0  a  supd|v!slon  Qf  s5ace  lnt0 
contiguous  col  is.  With  a  coarse  ceil  size,  this  model  |s  useful 
>n  obetacle  avoidance,  or  In  Identification  of  eutarees  of 
special  Interest  In  a  larder  scene,  a  depth  map  Is  a  two® 
dfmtnslonal  array  containing  the  distances  from  a  camera  Or 
raiding  device  tothe  nearest  surface  of  an  ooject  or  scena,  Tha 
low«l#val  Input  to  many  Programs  is  organized  in  this  fashion, 
(A  vacation  on  tne  aeoth  map  ls  the  dsctb  geld,  described  in 


■J  T  M  £  W  rETHOD?  Of 


lactic''  3,2.)  Wh»|e  space  raps  end  dPctn  r.aps  are  convenient 
^ays  c?  organizing  I  o  w-  i  « v#*  i  ^ata,  tney  havc  i;ttic  apr  !  :  cao ■ I i lv 

te  shara  cJ*scr 'at ] 0n. 


Some  suci iice  {jessticiiao  nethons  nay  be  classified  wit1”  depth 
r,aos»  ''h*n  tRa  aflscr'c-'cn  substitutes  depth  Contours  gr.ana|ytic 
f  notions  for  the  t.,0- d  1  rens  I  ona  I  oecth  array..  Blvariate  so  I  i  ne 
r'Yttlng  CCocnsD  fits  into  this  category.  worn  created  a  cecth 
contour  representat  I  on  from  assumptions  about  illumination  arc 
reflectance  cr>aracter  1  at  I  cs  CHernj, 


ao».it;°?i?§6erUW2S§-iR8  yfiSfSr^sixsJisnsifi^fJisii^sii 

use  of  prototypes  where  the  r e I  at  I onsh  Ids  of  faces  to  eo?es  and 
vertices  Is  defined  t  r  advance  for  a  fixed  number  of  primitives. 


Sc^e  more  iiex’ole  models  *ave  been  used  ov  other 
researcher».CSh|  ral  i  "aungartj,  This  tyc-e  of  model  Is  mainly 
sultec  to  ooiyheorai  out  approximation  of  curved  objects  by  a 
faceted  repr esentat I  on  has  had  some  success  in  computer  graphic* 
,  This  extension  of  what  Is  essentially  a  r*8thod  for  olane- 
hcundad  objects  Into  the  domain  of  curved  objects  cannot  be 
'erlousiy  considered  a  reasonable  candidate  for  shape 
description.  The  oody-f ac«»edC9-ver tex  model  describe*  surfaces, 
not  Volumes,  And  the  number  cf  Dienes  to  he  dealt  with  *>aKes  the 
rethoc  unwlaldy  for  curved  objects. 


Baalal  ails  icaaslccos  ceiu*,  Mott-Smithl  bear  some 
superficial  resemblance  to  representation  by  ceneralizec 
cylinders,  we  shall  devcte  *  paragraph  to  explaining  how  mealal 
axis  transforrs  a^e  derived,  tnen  show  why  they  do  net  provide  ar 
adeauate  description  of  shape, 


In  two  dimengiorif,  the  medial  axis  transform  is  ronetim^s 
called  a  BlUS  tranaiQrD.  The  Slum  transform  tor  a  given  share  ^ 
generated  es  follows)  Associated  with  every  point  in  the  inter'°r 
of  a  (two  ci  I  mens  i  ona  I)  shape  or  outline,  Is  a  maximal  disc 
neighborhood,  Figure  ? .  11  shows  some  points  in  the  interior  of  a 
rectangle,  and  t-helr  maximal  neighborhoods.  The  maximal 
-e i ghec rhood  of  any  cclnt  is  the  largest  disc  which  may  be 
centered  on  that  joint  and  stlil  remain  wlxhln  the  boundaries  of 
the  outline,  The  Slum  transform  of  the  shape  consists  of  the 
centers  of  ths  maximal  neighborhoods  which  are  no?  wholly 
contained  In  any  larger  neighborhood,  in  Floure  ?  ,11  the 
*'e  1  gheernood  of  oo'lnt  F  is  wholly  Inside  that  of  point  E,  and 
that  cf  point  C  Is  wholly  inside  that  of  point  f,  Only  the 
-e  I  gh.fccrhooos  of  points  A,  B,  and  E  cannot  be  wholly  contained  in 
er.y  larger  maximal  neighborhood,  ana  those  points  wiU  bo  cart  ot 
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Figure  2,11 
Maximal  Neighborhoods 

the  8 | urn  transform  of  the  rectangle,  The  complete  Blun  transform 
of  a  rectangle  is  snown  In  Figure  2,12, 

when  the  Blum  transform  Is  extended  to  three  d I  mens’  one#  the 
transforms  become  not  soaco  curves,  but  portions  ef  curved 
surfaces  In  space,  The  medial  axis  transform  ef  an  e i I T 0 s o T d  is 
an  eillose-shaped  olece  of  a  flat  surface,  centered  in  the 
a  I  I  I D  s  o  I  d , 


The  principal  objections  to  nedlal  axis  transforms,  are  that 
if  segmentation  l3  aocllad,  It  must  be  done  In  a  riSid  manner, 
that  Qaneratlon  of  the  transforms  reauires  knowledge  of  th# 
complete  object,  and  that  the  transforms  it  generates  are  non- 
1 ntul t I ve, 


881"BS*a* ' SS«SIH£-8T 


med  I 

It  hi3'"6eln v '  cbm'bu . . " J  ' 

Suitable  conditions  must  be 
branches  of  the  transform  which 
coJeet  from  those  which  arise  from 
from  a  reorasentat I  on  Is  the 
describe  aach  part,  and  that  the  segmentation 
y|*|d  the  slnpltst  description  of  each  part 


orSs*?n”r|n|'|ra^3form^ 
established  to  Differentiate  those 
represent  extremit’ea  of  the 
corners.  What  we  really  want. 


ability  to  segment  first,  and  then 


be  aoo i ! od  so  as  to 
With  medial  axis 
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2.4 


Flour®  2.12 

8|um  Transform  of  a  R®ct*ngl® 


t=srs;;r;v..!c!°s:?utlo-siofi,i?ii  is!?5isUo!»uriii.  ot"isShSi-ss 

th®  transform. 


Th*  entire  extant  of  an  object. must  bs  Known  in  ordsr  find 
th®  maximal  ns  I ghborhoods ,  This  orseludss  uss  of  tbs  metnod  on 
objects  obtained  from  only  ons  vlsw,  Two  dlmtnslons  shaoss  are 
usu*l|y  v | owed  In  thalr  #ntir®ty»  but  In  thr®«  dimsnslons  the 
«nt 1 rs  surf ac®  of  an  objsot  Is  difficult  to  obtain, 

A  non- Intuit  I v®  two-dlm#nslonal  madlal  axis  transform  may  bs 
s«sn  In  In  Flour®  2.13i  th®  Blum  transform  of  a  rsctangls  with  a 
notch,  A  minor,  vacation  In  th®  outline  oroducas  a  major 
oartorbat I  on  In  Its  transform,  In  thrs®  dimsnslons  th®  situation 
is  analogous,  Th#  madlal  axis  transform  of  a  coin  or.  flat  disc 
w|H  be  a  circular  portion  of  a  olane  with  rim-liKs  extensions  at. 
It®  cl  rcumf®renc«, 


Blun  Transfer")  of  a  Rectangle  with  a  Notch 


. 
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3  DEPTH  MEASUREMENT 


Tns  recognition  and  r«or*sentat  I  on  of  objects  as  performed  In 
the  exper  tmenta  I  oortlon  of  tM*  research  .reaujres  three- 
dimensional  data  on  whloh  to  operate,  The  Primary  requirement  i* 
that  the  data  o«  reasonably  dansa  and  reasonably  consistent, 
while  the  special  characteristics  of  our  laser  tr  lanou  I  atl  on 
system  are  made  use  of  In  many  of  the  technloues  to  be, described, 
we  oeileve  our  mathods  are  general  enough  that  other  means  of 
ranglro  can  be  substituted, 


3,1  SOME  METHODS  of  depth  MEASUREMENT 

a  fairly  comofehensiye  ,  catalogue,.  of  methods,  or  deoth 
measurement  is  gTveh  Tn  Ohaoter  7  or  lEarnestj,  Only  the  more 
suitable  of  tne3e  afe  discussed  below, 

Device*  exist  wh  ch  »r«  capable  of  directly  measuring, the 
distance  from  the  dev  ca  to  some  point  on  an  object  o 1 aced_Def ore 
1 1 «  All  of  these  dev  ces  are  variations  on  the  basic  method  of 
t|me-of-f light  measurement  of  light,  For  the  distances  In  which 
-e  art  Interested,  this  usually  takes  the  form  of  a  laser  beam 
modulated  by  a  sinusoidal  signal,  and  a  detector  and  ohase 
measuring  circuit  which  determines  the  ohase  shift  of  the 
reflected  light  wfth  respect  to  the  emitted  light.  An  example  of 
such  en  Instrument  Is  the  Geodollte,  manufactured  by  Soectra- 
physlcs,  Mountain  view,  California,  Its  dsoth  resolution  of  l 
millimeter  la  Probably  adeauate  for  our  purposes,  Direct  ranging 
devices  require  a  two-axis  deflection  system  (usually  a  pair  of 
rotating  mirrors)  In  ordar  to  scan  a  scene.  The  resoonse  time  of 
tho  Snectra-Physlcs  Geodollte  is  on*  millisecond,  with  a 
DPoper|y  designed  mirror  scanning  system,  It  would  rsouir®  only 
90  seconds  to  scan  an  entire  scene  with  a  raster, resolution 
comparable  to  our  television  cameras.  At  or*sent,  its  cost  ie 
Prohibitive*  comosrsd  with  othsr  methods  available,  As 
technloues  In  this  area  Improve,  direct  ranging  may  beoome 
competitive  with  other  ranging  metnods. 

Two-camera  stereo  Is  attractive  mainly  from  the  point. of  view 
that  It  Imitates  human  sterso  depth  perception,  while  research 
using  twe-oamara  stereo  may  shed  light  on  human  depth  perception 
<or,  more  ll«e|y,  stimulate  further  research  In  this  are*)  w» 
fe*|  two-camera  ster*o  Is  hardly  the  bast  w*y  to  measure  deoth  by 
computer  when  *e  tr#  Interested  In  sceed,  efficiency*  o, 
accuracy,  Tr lanCulatlon  by  laser  (see  the  next  Section)  rtouire8 
on*  Tv  camera,  jf  other  character  I st I cs  of  an  object,  such  as 
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color  or  texture,  are  reaulreg,  a  stearate  TV  image  of  the  scent 
m ay  be  obtained  with  little  additional  cost,  In  3eneraJ,  [t  Is 
desirable  to  nave  alternate  modes  of  perception  for  varying 
tasks , 

To  measure  decth  by  stereopsis  It  Is  first  necessary  to 
1  o*nt  I  f  y  points  In  each  l„age  v,nlch  cOPreSDOnd  to  the  ?e„e  do  '  nt 
on  the  actual  object,.  Either  some  Preliminary  recognition  must 
be  performed  on  the  scene,  or  correlation  must  oe  performed  on 
the  fine  texture  of  the  scene,  To  use  a  higher  level  analysis 
(such  as  a  sort  of  low-level  recognition)  to  control  the 
acaulsltlon  or  orocesslng  of  low-level  Incut  Is  attractive  as  a 
Soil  for  future  research;  but  to  this  date  such  technioues  have 
not  been  demonstrated,  Correlation  of  texture  either  restricts 
u$  to  coarse  textjred  ooJects  or  reoulres  a  much  higher  spatial 
resolution  than  |s  currently  available  in  imaging  devices. 

R ,  K,  Nevatia  has  used  motion  5t0r»o  with  textur6  correlation 
+  o  measUp*  deoth  at  selected  oo|nts  on  th°  3urfac#  °f  r  0  c  k  a  •  Hia 
methods  yield  a  deDth  accuracy  similar  to  that  of  cur  laser 
tr langulatlon  system,  but  the  average  processing  time  he 
estimates  to  be  about  13  seconds  per  point, 

Tr langulatlon  using  a  beam  or  plane  of  light  ana  an  imaging 
device,  as  outlined  In  the  following  Section,  appears  to  be  the 
beat  Practical  peans  of  three-dimensional  scene  acsuJsltlon 
aye  Mab|e  at  present. 


3,2  TRIANGULATION  BY  LASER 

Tr langu lat I  on  by  laser,  (for  the  case  where  the  laser  beam  is 
not  diverged,)  is  geometrically  similar  to  stereo,  consider 
replacing  one  stereo  camera  by  a  deflectable  laser  beam,  jh# 
horizontal  and  vertical  deflection  angles  of  the  beam  correspond 
to  the  raster  coordinates  In  the  canePa,  The  c-oolem  of 
I  cent  I f i cat  I  on  of  a  single  point  In  the  two  "views"  is 
Practically  eliminated,  since  |n  the  remaining  TV  Image  the 
bright  laser  spot  Is  easily  detected, 

Oata.rat*  .for  tc I angu I  at  I  on , by  an  undiverged  beam  would  be 
rather  low,  since  for  each  oo'nt  measured  the  laser  must  o§ 
dtf|ected,  the  jv  camera  must  be  read,  and  the  bright  soot 
lotnt|f|ed,  The  maximum  data  rate  using  an  undiverged  oeam  would 
be  30  to  6 o'-  data  points  per  second,  eased  on  tne  time  -eculred  to 
reed  one  TV  Image, 
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A  significant  Improvement  In  data  rate  Is  obtained  oy 
o  I  v  #  r  5  !  rv3  the  I  a3er '  s  oenc  I  I  beam  Into  a  plane  of  light,  as,  foj; 
lpstap.ce,  by  passing  the  bean  through  a  cylindrical  lens.  Such  a 
ien$  will  magnify  or  spread  the  beam  In  one  dimension  only, 
transforming  the  circular  laser  beam  Into  an  elongated  ellTpset 
cr  plane  of  light,  The  angle  of  divergence  of  the  olane  of  light 
w|l|  be  equal  to  the  diameter  of  the  und!verged  beam,  divided  by 
the  focal  length  of  the  lens,  An  additional  advantage  of 
diverging  the  beam  Is  that  only  one  rotating  mirror  will  be 
necesgary  to  enable  the  beam  to  cover  every  Dart  of  a  scene, 

To  see  how  gecth  may.be  measured  with  a  olane  of  light.  It 
Tg.v  be  Instructive  to  tnlnk  of  tn*  Diane  as  being  comoosed  of 
n-any  Individual  r^ys  of  light  emanating  from  a  point,  As  long  as 
th»  rays  do  not  cross  or  coincide  In  the  camera's  Image,  each  ray 
Is  Identifiable,  This  restriction  la  eaulvalent  to  tha  condition 
that  the  olana  of  light  (and  Its  infinite  extension)  not  Include 
the  focal  oolnt  of  the  camera, 

The  only  visible  1 1 Iymlnatlon.on  the  scene  Is  In  th*  plane  of 
l 1 c h 1 1  hence  aT I  illuminated  points  are  on  the  Plane,  There 
exists  a  unjaue  coljlneatlon  (one-to-one  correspondence)  between 
oclnts  on  the  Diane  and  points  In  the  TV  Image,  once  the 
cc  I  I i neat  I  on  Is  known,  the  three  dimensional  coordinates  of  any 
Illuminated  point  may  be  determined  from  Its  location  In  the  TV 
1  nr.age  , 


The  deoth  accuracy. of  a  tc langu I  at  I onsystem  depends  on  the 
-eso'utlon  of  the  imaging  device  and  on  the  angle  of  separation 
between  the  two  points  of  view,  (Refer  to  Figure  3.1.)  The 
Inherent  resolution  of  an  Imaging  device  gives  rise  to  a  cone  of 
uncertainty  for  any  glvan  point  in  an  Image,  The  width  of  the 
cone  at  the  object  being  viewed  we  call  0,  The  uncertainty  In 
lateral  Position  because  of  the  resolution  of  the  Imaging  device 
Is  D  /  2,  If  the  angle  of  seoaratlon  between  the  camera  and  the- 

D  /  2 

laeer  is  $,  then  the  maximum  uncertainty  In  position  Is  ---•-, 

tan  $ 

The  root-mean-sauare  uncertainty  w|  |  I  be  0,707  times  this,  or 

<RMS  range  errOr>  *  0,353  D  oot  G>.  CEauatlon  3,13 

If  the  width  of  th*  laser  plane  Is  more  than  one  raster  unit, 
then  the  uncertainty  0  should  also  Include  the  uncertainty  In 
locating  the  centerline  of  the  plane,  For  a  tyoloal 
configuration  of  our  ranging  system,  the  contribution  to  D  due-to 
th*  resolution  of  the  TV  camera  Is  about  0,05  Inches, 
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Uncertainty  In  locating  the  |as*r  centerline  nay  add  ar, 
additional  zero  to  2.35  lncne„  to  th,s  flflu re.  $  i,  usually 
about  30  degreesi  giving  a  Uniting  range  accuracy  of  0,235  to 
2,27  Inches,  calibration  Errors  will  add  further  Inaccuracy,  but 
these  will  not  change  relative  accuracy,  Calibration  and 
calibration  errcrs  are  discussed  In  seC-l°n  3, a  and  in  Appendix 
A. 


a  system  similar  to  the  above  was  Independently  designed. by 
S  h  1  r  a  i  and  suwa  at  f!  I  ectrotechn  !  ca  |  Laboratory#  Tokyo  CShiraU, 
Conventional  ootics  were  used  in  a  slit  Drojector  to  oroject  a 
d l»ne  of  I  Ight, 

Tho  advantages  of  using  a  laser  oyer  using  conventional 
optics  jrre  practical,  not  theoretical,  The_  Drincinal  advantage 
Is  that  a  Diane  of  light  from  a  laser  Is  uniformly  thin 
throughout  --  hence  the  death  of  field  of  tne  source  Is  less 
HiTlt*d,  (There  still  remains  the  Droolem  of  depth  of  field  of 
the  Camera's  optics,)  in  addition,  Placing  a  narrow  oand-pas* 
optical  filter  In  the  camera  ootics  blocks  most  ambient  light, 
W|tn  the  filter  In  Dlace,  our  system  will  operate  In  a  sunlit 
room  with  no  noticeable  degradation  In  performance, 

rrc"oJl!?o»S!i2!t5!sa8S3!{?8,s,s;,a5iP9.  A,lta*£n.tnlilr  fj8St'S| 

e|tner  white  or  a  color  with  a  red  component,  Objects  o?  other 
colors  reflect  little  or  no  laser  light,  Tunable  lasens  Or 
mu  1 1 1 -wave  I ength  lasers  nay  eliminate  this  Problem  in  the  future, 
but  such  |asers  n^e  now  rathar  expensive,  and  would  reaulre 
ejection  of  the  b«am  without  a  filter, 

[or  optimal  dtDth  discrimination,  the.  p| ane  of  1 1  act  should 
b«  perpendicular  to  the  plane  aeffneo  by  the  TV  camera,  the  laser 
deflection  assemoly.  and  the  center  of  the  scene  being  scanned", 
F"cr  best'  coverage©?  the  scene,  the  axis  of  motion  of  the  plane 
of  |lgnt,  when  It  Is  scanned  across  the  scene,  should  also  be 
cerpend I cu I ar  to  the  same  olano. 

In  order  to  obtain  more  oomplete  and  isotropic  data,  scannlnc 
takes  place  with  two  different  orientations  of  the  ojane  of 
light,  The  plane  of  light  In  the  second  orientation  Is  at  rloht. 
ar.0!*s  to  the  Plane  In  the  first  orientation,  and  both  are  at  45 
oegr"es  with  r®soect  to  the  optimum  Diane  for  oest  depth 
accuracy,  Although  the  orientation  degrades  depth  accuracy  for 
each  scan,  the  fact  that  we  have  two  Independent  measurements 
Increases  th<»  accuracy#  and  the  final  accuracy  is  Identical  to 
that  computed  In  Eouation  3,1,  or  0,353  j  cot  $ • 
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In  scanning  a  scene,  the  TV  campra  is  read,  the  Diane  of 
Mont  ls  moved  by  means  of  a  ro;&t,n5  mlrror,  t*19  TV  ^ad  again, 
and  the  cycle  r«c*ats  until  the  entire  scene  has  been  covered, 
Th«  cylindrical  lens  Is  then  rotated  oz  degrees,  and  the  entire 
scene  scanned  In  +  hls  Orientation,  A  iaSfic  scao  refers  to  one 
ip-.age  frem  tne  Ty  camera,  or  the  data  derived  from  one  image. 
When  the  data  Is  concerted  to  three-dimensional  coordinates,  the 
resuit  Is  a  dfioib  acid.  The  distance  between  successive  laser 
sc*ns  Is  *' 1  ° 9 r  tnan  tne  r*so|Uti9n  of  the  tv  raster.  F0P  each 
laser  scan  we  hav#  2  decth  profile  along  a  line,  the  deoth 
OrOfMes  form  a  sort  of  decth  mao,  if  we  imagine  viewing  the 
scene  from  the  point  of  view  of  the  laser  deflection  aoDaratus, 

Ar.  Interesting  oossloMIty  fop  high  speed  scanning  of  a  seen# 
I s  suggested  by  the  work  of  will  and  pennlngton  C  w  T II 3 ,  Their 
acDrOach  to  ranging  is  to  Project  a  uniform  ooded  grid  onto  t 
sc*ne  from  a  slide  projector.  Tnis  Is  eculvalent  to  reading  many 
laser  scans  in  a  sln3le  fran9  from  the  TV  camera,  will  and 
Pennington  made  nc  attempt  to  measure  deoth  directly#  wnlc'n  would 
have  required  Identifying  each  line  In  the  Image,  They  were  able 
to  extract  the  normal  directions  to  plane  facets  Illuminated  In 
this  manner,  but  performed  no  recognition  or  determination  of  the 
bouncarles  of  the  facets.  However,  if  one  were  to  use  a  coded 
S r I d  in  which  the  code  carries  Positional  Information,  the  time 
to  scan  a  scene  would  be  only  tn9  time  it  takes  to  read  one  TV 
Image,  some  tyoes  of  coded  grids  they  suggest  are  a  shift 
register  derlveo  code  Plate,  or  the  grid  known  In  ootlcs  .as  a 
linear  zone  Plate,  Additional  Processing  would  oe  necessary  to 
Identify  «ach  I  In#  In  the  image,  The  techniques  to  extract  the 
coding  will  be  exc«nsive,  but  for  seme  applications,  a  tradeoff 
of  data  acquisition  tine  for  computation  t'mo  may  be  desirable. 


3,3  HARDWARE 

The  oaslc  eomconents  of  tne  laser  ranging  hardware  are: 

The  laser, 

Periscope  and  auxiliary  nlrror(s)  to  bring  the  betm  to 
the  deflection  assembly, 

The  deflection  assembly,  consisting  of  a  spherical 
focussing  iens,  a  cylindrical  diverging  lens,  and  a  rotttTnc 

*1 rror . 
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The  Interference  filter. 

A  television  camera  capable  of  being  read  by  the 
computer . 

The  hardware  Js  located  on  the  Hand«£ye  table  at  the. Stanford 
Artificial  Intelligence  Laboratory.  An  overall  view  of  the  3etuo 
Is  shown  In  "Uure  3.2. 


Tne  laser  Is  a  So«ctra-Phy*  |  es  He-N*  laser*  model  135, 
emitting  red  light  at  a  wavelenotn  of  6328  angstroms.  Rated 
cc"er  of  tnis  mod*  |  Is  5Z  milliwatts,  but  measurements  indicate 
an  actual  power  output  of  about  35  milliwatts.  Calculations 
based  on  naxlmjm  sensitivity  of  the  vtdlcon  tube  and  the  optical 
parameter s  of  the  system  Indicate  an  output  of  10  milliwatts  to 
be  the  minimum  for  this  application,  Our  35  milliwatts  aooears 
T-o  o*  aoeauate,  provided 

<1)  control  !s  maintained  of  the  focussing  of  the  beam,  end 
<2)  an  Interference  filter  of  sufficient  duality  !s  us«d, 


For  optimal  scanning  of  a  scene,  the  angle  at  which  the  laser 
beam  impinges  uoon  the  deflection  assembly  Is  tmoor-ant,  jhe 
beim  should  be  otroend i cu 1 ar  to  the  axis  of  rotation  of  the 
rr|rror,  and  as  shown  In  the  previous  Section  (Section  3.3),  the 
axis  of  the  mirror  snould  be  ptroend  I  cu  I  ar  to  the  oltne 
determined  oy  the  camera  lens  center,  the  center  of  tha  ratatlno 
mirror,  and  the  center  of  the  scene  to  be  scanned.  The  perlscooe 
ar.d  auxiliary  mirror  are  for  bringing  the  beam  from  the  laser, 
(located  under  the  table),  to  the  deflection  assembly,  In  the 
oroper  orientation,  The  oerlscope  consists  of  two  telescoping 
st*ol  tubes,  with  a  front-surface  mirror  Qlued  Into  eacn  end  at 
an  angle  of  *5  degrees  to  the  axis.  The  telescoD*  arrangement, 
allots  adjustment  of  the  height  of  the  beam  above  the  taole  and 
of  the  azimuth  of  the  bean,  The  auxiliary  mirror  Is  mountad  on  a 
oa  I  I -end-socket  ciamo  which  allows  an  arbitrary  orientation  of 
th«  beam. 


Figure  3,3  shows  the  essential  features  of  tbe  laaer 
ceflectIon  assembly,  The  focdsslns  lens  Is  necessary  msl«!y 
oecause  of  the  poor  colMmatlon  of  the  beam.  At  the  laser,  tha 
oeam  Is  a  uniform  soot  about  3  millimeters  wide,  Th 1 » _ d T veroee 
to  a  complex  pattern  of  soots  and  rings  apout  5  millimeters  wide 
at  the  deflection  assembly,  The  focussing  lens  has  a  focal 
length,  of  50£  millimeters,  and  orlngs  the  beam  to  a  soot  about  2 
millimeters  across  at  the  center  of  the  scene,  when  the 
cylindrical  lens  Is  absent. 
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The  cylindrical  lens  Is  a  short  clece  of  °yrex  glass  rod, 
Its  focal  length  Is  approximately  4  millimeters.  The  cylindrical 
lens  diverges  the  beam  only  In  the  direction  perpendicular  to  the 
axis  of  the  lens,  and  changes  the  circular  cross  section  of  the 
laser  beam  Into  ar.  elongated  ell  lose.  A  stepper  motor  may  rotate 
the  lens  to  change  the  direction  of  elongation, 

a  f ront-surf ace  mirror  Is  mounted  on  the  shaft  of  a  gear 
reduction  head  attached  to  a  stepper  meter.  This  arrangement  Ts 
eaOaMe  of  scanning  the  beam  or  blane  of  light  across  the  scene. 
The  resolution  of  the  motor-? I us-gear-reduct Ion  Is  1723  st«DS  oe? 
revolution  at  the  outout  shaft, 

The  entire  def lection  assembly  is  mounted  on  a  balloand- 
sccket  clamp  to  a  I  I o w  alignment  with  the  Incoming  beam  and  proper 
orientation  of  the  outout  Illumination, 

Tne  function  of  the  Interference  filter  Is  to  screen  out 
an-blent  light,  and  let  only  reflected  laser  light  reach  the 
v|d|con  tube,  its  use  Is  necessary  only  when  working  In  a 
oafkered  room  Is  undesirable,  We  have  experimented  with  two 
d|ffePent  filters,  both  manufactured  by  Octics  Technology,  Inc, 
The  first  has  a  bandpass  Of  8,6  angstroms,  and  a  transmission  of 
about  55  percent  at  6329  angstroms,  with  this  filter  we  have  had 
no  difficulty  obtaining  good  TV  Images  In  daylight.  However  the 
2,37  Inch  thickness  Of  this  filter  made  it  unsuitable  for 
Incorporation  Into  the  color  wne9|  of  a  new  television  camera 
Or*sent|y  being  I nstrumented ,  A  thinner  filter  purchased  for  the 
color  wheel  proved  unsatisfactory,  Its  bandpass  Is  about  20 
angstroms,  but  other  calibration  data  ape  lacking,  Lowe? 
transmission  at  6328  angstroms  and  higher  transmission  at  other 
wavelengths  leave  too  little  contrast  for  daylight  operation, 

The  Present  configuration  Is  tricky  and  t I me-consum } ng  to  set 
up.  Usually  about  one  hour  Is  retired  to  set  up  and  calibrate 
the  eaulpment,  A  more  permanent  setup,  oernaps  with  the 
Oef|ectlon  assemoly  mounted  on  top  of  the  periscope,  Is  peine 
contemn | ated , 

Hgure  3,4  Is  the  television  image  0?  a  Barbie  do  |  |  in  place 
on  the  table,  ready  for  scanning,  yne  table  has  bean  covered 
with  a  dark  cloth,  to  suopress  the  background  of  the  picture  (the 
tabletop),  The  laser  Plane  cf  light  may  pe  seen  illuminating  the 
subject,  starting  at  the  right  shoulcer  of  the  doll,  going  across 
the  right  breast  a^d  the  stomach,  to  cross  the  left  leg  near  the 
kn«e , 
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Figure  3,4 

TV  Image  of  a  Barbie  Doll 


3,4  CALIBRATION 


Calibration  j§  tha  Drocess,.  whereby  we  measu 
oarameters  In  c.-der  to  be  ab|e  to  reconstruc 
dimensional  coordinates  of  points  In  a  scene. 


.  Calibration,  at  Stanfordi  nas  come  to  mean  the  determination 
of  exact  parametric  models  for  cameras  and  arms  (manipulators), 
so  that  all  coordinates  may  be  measured  relative  to  a  fixed 
coordinate  system,  The  ability  to  refer  to  and  to  access 
absolute  coordinates  makes  communication  between  parts  of  a  larfle 
system  simpler.  But  for  a  general  Purpose  Intelligent  machine, 
absolute  locations  will  not  be  as  useful  as  relative  ones.  There 
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Is  I'ttl*  evidence  to  indicate  that  nunan  perception  nukes  use  of 
an  absolute  frane  of  reference,  father*  we  are  aware  of  the 
locations  of  objects  relative  to  eacn  other,  and  of  ou*  own 
oositlon  relative  to  our  sur rojnd  I  n3s ,  Aharon  GMI  CSMI3  has 
shown  now  visual  servolng  of  a  con outer-con trolled  manioulator 
can  achieve  alignment  of  carts,  wltn  reference  to  absolute 
Positions  only  fo }  initial  oositlonlng  and  searching, 

For  recognition  of  Objects,  tne  Important  cues  come. from 
relative  Information.  Sizes  and  distances  on  an  object  are 
Invariant  with  rotation  ana  translation.  Normal  directions  to 
surfaces  are  computed  locally,  The  directions  we  comoute  are, 
for  convenience,  relative  to  some  global  coordinate  system,  but 
what  matters  Is  the  relative  orientations  of  different  surfaces. 

In  consideration  of  this,  DhilosODhy,  the  emohasi*  of  th* 
calibration  of  the  laser  ranging  system  is  on  relative  accuracy 
cf  oerceDtIon, 

Calibration  ta*es  place  In  two  chases,  camera  calibration  and 
I aser  oa I  I  brat  I  on. 

Camera  cal  location  involves  establishing  a  cor resoondence 
eetwean  points  on  the  tab:ctoo  ana  ooints  In  the  TV  Image,  Tne 
Plane  of  light  is  Orojected  on  the  table  too,  and  six  laser  scan* 
are  raad  by  the  camera,  In  the  pattern  shown  In  Figure  3,5,.  The 
nine  Intersections  of  the  laser  lines  are  measured  on  the  table 
too,  relative  to  a  local  coordinate  system  (usually  with  It* 
center  near  the  center  of  the  calibration  pattern,  straight 
lines  are  fit  to  each  laser  scan  In  the  TV  i'saee  and  the  nine 
Intersections  of  tne  straight  lines  are  calculated.  The  PPAXIS 
m  j  n  i  ir  i  7at  I  on  Program  aeveloped  by  Richard  Brent  and  Irwin  Sobel 
determines  the  values  of  the  camera  parameters  which  give  the 
best  correspondence  between  the  nine  measured  Intersection  ooints 
ana  the  nine  Intersections  of  the  laser  scans  In  TV  coordinates. 

Five  camera  Parameters  are  determined  by  the  calibration 
Program:  the  camera's  orientation  with  resoect  to  our  local 
coordinate  system  (can,  tilt  and  swing  angles),  and  the 
horizontal  and  vertical  scaie  factors  of  tie  camera.  Three 
additional  parameters,  denoting  the  oosltion  of  the  camera  lens 
center,  are  measured  approximately  ito  the  nearest  inch),  and  ere 
neid  fixed  during  the  minimization  crocess.  From  these  elgnt 
Parameters,  It  is  possible  to  determine  a  matrix,  CAMTRANS, 
relating  ooints  In  the  scene  to  tne  I  r  coordinates  as  ooserved  5  ** 
the  Tv  Image,  The  relation  Is: 
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Figure  3,5 
Cal Ibratlon  Pattern 

U  X 

V  =  CCAMTRANS3  •  Y  [Equation  3.23 

H  H 

1 

wh«re  X,  Y»  and  2  are  the  coordinates  of  the  object  DOinti  and 
the  I  (rage  point  coordinates  are  given  by  U/H  and  V/H, 

Dosl^lfi^Slt^resoSct1  tocouf ^foca?  coorlVha?ensys?em  *mayC8r oSuce 
absolute  errors  In  location  of  points  located  far  fron_the  cente^ 
of  the  scene,  but  the  relative  errors  will  be  limited  to  a  slight, 
warping  or  scaling  of  the  scene. 

Laser(iUcal  Ibratlon  Is  based  on  minimization  of  .fetching 
errors.  Where  two  laser  traces,  arising  from  two  ditTirent 
rotations  of  the  cylindrical  lens,  cross  In  a  scene,  different 
determinations  of  deDth  may  be  obtained  for  the  point  ..where  they 
Cr0s9,  we  call  this  difference  the  matching  error,  Laser 
ca1 Ibratlon  adjusts  the  oarameters  of  the  laser  def|«otlon  system 
to  minimize  the  sum  of  the  souares  of  the  matching  errors  ovtr  a 
sc® no , 
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If  t^e  position 
tne  remainder  of  the 
f rom  the  ca I ibration 
sha | I  show  below, 
aoJusted  by  ihe  m 
cef lection  assem& | y 
A  rough  initial  ir.ea 
tr  i  n  iir  I  Zer  , 


of  the  laser  deflection  assembly  Is  known, 
laspr  deflection  oarameters  may  be  comouted 
pattern  a^o  Known  physical  parameters,  as  we 
Thjs,  the  on|y  parameters  whfch  must  Oe 


pattern  a^o  Known 
Thus,  the  on|y 
inimlzer  «r^  t"e 
w}tn  r9soect  to  our 
Surement  previous 


parameters  wh{Ch  must  oe 
position  of  tne  laser 
local  coordinate  system, 
a  starting  point  for  the 


h  "E°s,iti0n  cf  the  J?*er  oef  lection  assembly".  (or,  for 
br-v'ty,  the  laser  cents.")  we  take  to  mean  some  coin*  on  the 

surface  of  the  .rotating  mlr-or.  Tne  laser  light  actually 
emanates  from  a  virtual  oolnt  ne^ind  the  mlrrOr,  put  there  is  a 
small  area  on  the  surface  of  tne  mirror  tnrough  which  all  Dianes 
of  fight  pass,  for  *he  Purposes  of  calinratlon,  we  assume  tha 
1  :  ght  to  emanate  from  the  center  of  tne  area,  ( we  discuss  the 
Validity  of  this  assumption  in  Append!*  a,) 

sr;f!sf:?£5f>§°iTr  .sstmitcu 

be  determined  from  Point  3  and  point  H  In  Figure  3,5  and  tne 
laser  center,  The  Dlane  in  the  horizontal  cosltion  |s  determined 
jrbm  points  0  ana  F  and  the  laser  center.  Points  A  and  I  and  tne 
laser  center  determine  a  pi ane  which  we  assume  to  be 
Perpendicular  to  the  axis  of  rotation  of  the  rotating  mirror, 
(Tne  validity  of  so  assuming  we  discuss  in  Appendix  a,) 


mere  is  a 
all  R I  anas 
assume  tha 
discuss  tha 


laser  center, 
frbm  points  D 
laser  center 
Perpendicular 


T0  ootain  the  coefficients  of  tne  plane  of  light  wnen  the 
mirror  is  at  some  position  other  man  zero  rotation  reouires  a 
series  of  transf ermat i ens ,  Tnese  are  a  translation,  T,  to 
.rensform  the  laser  center  to  the  origin  of  coordinates,  a 
rotation  R  to  align  the  mirror  axis  cf  rotation  with  the 
a  rotat|on  M  abcut  the  vertica|  axis  c°r rt socnc  i  ng  to 
Twice  the  aniile  of  rotation  of  the  mirror,  followed  by  rotation 
by  R  inverse  and  a  translation  by  T  inverse  to  restore  the 
original  orientation  of  the  axis  and  position  of  the  laser 
center,  When  the  Plane  of  light  is  expressed  in  homogeneous 
coopd-nates,  the  transformations  may  be  represented  by  matrix 
"•ultip!  icatior.s.  (See  CRooe-ts  633  for  an  excositlon  of 
homogeneous  coordinates  and  transformations,)  To  obtain  the 
coefficients  of  tne  Plane  of  light  at  a  mirror  rotation  of  9  use 
the  following  matrix  eoua-cion: 


plane ( 8 )  =  plane(O)  «•  shift  «  rotatco)  «  shift’1 

CEguation  3.33 
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yl».«  a  colt  I  nee* I  on  COLL  ,uch  th«t  t»e  „hy,lcal  eooLoTn.t*,  of 
any  oolnt  on  the  lm,ge  of  the  ecan  line  Is  given  by  '  *  3 
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CSquatlon  3.43 


?/hs:e.Kd,i/dHv.;;eits,h;h»?j:i  sssp3!ss?n.of  th*  *"«  *'•<. 

sks'w  a: 

.  ?  r  li VBJ™”  "*&««' 

StJli  shift  In*  horizontal  and  vertical  or  I  entatlons,  the 

thos{«SoSis:?oi55to5!j?!?y,;,t?;.  siiWiSMsl-jrus 

irlrror  to  the  olano  determined  as  mentioned  above,  contribute  at 
least  as  much  to  the  uncertainty  of  ranae  determination  as  the 

Win  zt"  —  -»•* 

^■t*!ss?;ris,7?r|irts5ST“-‘Tsso,,ip"*sirw"-5ss«“«*  *««s*n 

ortne  laser  lines  U-ad  us  to  exoect  an  absolute  erro?  In 
ne.ghborhood  of  0,033  «.o  0,070  Inch,  rr0r  n  th* 
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4  PRELIMINARY  PROCESSING  and  curve  fitting 

This  chapter  describes  the . I ow- I  eve |  proctsslno  necessary  ta 
convert  the  TV  Images  obtained  with  laser  Illumination*  to 
useable  depth  Information  for  the  description  routines, 

The  unprocessed  data  exists  as  Images  on  the  vldjcon..  of  the 
Tv  camera,  the  output  of  the  preliminary  processing, routines 
will  be  a  set  of  curves*  which  may  oe  combined  with  the  laser 
calibration  data,  to  reconstruct  the  original  sc«na  In  three 
d  |irens  |  ons. 


4,1  LINE  EXTRACTION 

The  TV  camera  t$  rflad  by  a  standard  routine  from  the  Stanford 
Hand-Eyt  Library  CpTngle],  Output  from  this  Program  [a  an  array 
of  four  bit  brightness  samplas*  packed  nlna  to  a  36  bit  PDP-10 
word, 


w#  scan  this  array  for  non-zero  brightness  bytes»  .  and  ator* 
the  brightness  and  coordinates  of  the  nonzero  samples  In  an 
erray.  One  samole  occupies  one  word  of  date.  Although  the 
storage  requirements  are  hlghef  for  each  sample*  because  most  of 
the  olcture  Is  dark,  there  Is  a  net  reduction  1ft  storage  peaulred 
of  about  20  to  one  as  Q  result  of  this  operation.  Detection 
typically  reou!r«s  about  5,9  microseconds  oar  wsrd  which  contains 
all  Zero  samples,  end  about  271  m|  Cr0»*<^«d5  per  nonzero  word, 
For  e  typical  picture  of  2300  words*  this  processing  reaulree 
about  48  milliseconds,  This  averages  to  20  microseconds  per  word 
cr  2,2  microseconds  per  point. 

Figure  4,1  displays  the  nonzero  samples  detected  in  ono  frame 
of  television  Inout  for  the  3arble  doll  of  Figure  3,4,  (The  plane 
of  light  for  this  Image  passes  from  the  ioft  shoulder*  sorbs*  the 
left  breast  end  the  stomach,  and  along  the  right  thigh,)  The  line 
appeapa  wider  across  the  body  then  along  the  leg,  This  is 
Principally  becausa  the  body  of  the  doll  faces  the  laser 
deflection  ms3emb|yj  light  from  the  deflection  assembly  strikes 
the  surface  perDend leu Itr ly.  The  leg  Is  obllaue  to  the  laser 
Illumination,  end  the  total  illumination  per  unit  surface  area  of 
the  leg  Is  smal I  *  r , 


lines  thus  detected  are  usually  several 


The  ,  .  _ 

broaO,  The  breadth  obtained  Is  principally  due 
brightness  threshold  made  necessary  oy  Intensity  varlat 
the  lint,  The  line  Is  generally  brlghtar  near  Its  mldd 
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Figure  4 . 1 

Non-zero  Brightness  Samples  Fron  One  Laser  Scan 

e|ther  *nd,  and  hue  and  Intensity  on  the  object  being  scanned 
account  for  a  great  deal  of  variation,  In  order  to  detect  the 
dimmest  lino  In  the  scene  a  low  cHoping  level  or  threshold  Is 
Irr.oosed  on  the  hardware,  This  results  In  saturation  in  the 
orlghter  areas  of  tho  line.  Although  the  ed3es  of  the  line  are 
olur  wi^h  respect  to  the  center*  the  edces  are  detected  where  the 
Mne  Is  bright,  Refocussing  of  either  the  laser  bean  or  the 
camera  have  not  b«en  found  to  have  a  significant  effect  on  the 
width  of  the  line, 


The  line  Is  *h|nned  by  locating  Its  centerline,  Horizontal 
ana  vertical  "slices"  are  made  through  the  Dlcture,  Fpr  overy 
horizontally  or  vertically  contiguous  set  of  points*  the 
coordinates  of  the  center  of  that  set  are  Placed  in  the  array  for 
the  thinned  line,  The  center  Is  computed  by  weighting  the 
Dosltlon  of  each  same le  by  Its  brightness,  and  taking  their 
average.  Figure  4,2  shows  tne  line  of  Figure  4,1  after  thinning. 
In  this  figure  we  see  severe!  points  tnat  are  not  near  ths 
centerllne  of  the  trace,  principally  where  the  trace  is  vertical. 
These  points  arise  fron  vertical  sections  c&sslng  along  th#  edge 
of  th*  unthinned  trace,  The  operation  which  links  the  points 
will  eliminate  these  sourlous  points, 
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F I flur®  4 * 2 

L«s«f  Trace  After  Thinning 


a  better  th]nnlnfl  ooeratlon  would  take  centerlines  only 
oerpend I cu lar  to  the  aPDrOxlmate  direction  of  the  line,  HQwever, 
no  3lng|e  direction  of  search  can  aoDly  to  an  entire  laser  ecar-, 
even  If  the  crl*ntatlon  of  the  laser  plane  Is  knownj  |lne$  may 
1 1 •  «t  any  orientation.  The  only  way  to  apply  this  would  be  to 
first  epp|y  a  local  analysis  to  the  line  at  several  dlaces  to 
determine  the  direction  cf  the  line, 

a  single  proflram  controls  the  rotating  mirror  and  television 
camera#  and  performs  line  detection  and  thinning.  The  usual  mode 
of  operation  Is  to  use  this  Program  to  manually  adjust  the  camera 
Parameters  for  optimum  contrast#  then  to  soeclfy  to  the  orooram 
the  Initial  beam  position,  step  Inorement#  and  nurber  of  steps  to 
scan  fc  scene,  The  Program  w I | I  automatically  stao  tha  mirror, 
read  the  TV  camera,  deteot  the  nonzero  brightness  samoies#  and 
store  their  coordinates  on  the  disk,  A  second  oass  of  the  same 
Program  reads  the  data  stored  on  the  disk  for  the  th’innlno 
oper>t 1  on, 

Or.  a  disk  f|i#  are  stored#  for  each  laser  scan,  the  angular 
oosltions  of  the  mlfror  and  the  cy|!ndrlcel  lens#  the  numoer  of 
oo'nts  detected  !n  the  Image#  the  coordinates  of  each  point#  and 
If  thinning  has  n0t  yet  been  done,  the  brightness  of  each  oolnt, 
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F  I  gure  4 , 3 

Multiple  L*3er  Traces  of  a  barole  Doll  After  TninnlriO 


L1.NL  EXTRACTION 
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Figure  4,3  <s  a  composite  of  all  the  laser  traces  of  the 
8arb I e  doll,  afte;  thinn,n®'  Noar  th«  lower  plaht  coPne;  we  »ee 
several  traces  where  the  black  cloth  on  the  tabletop  has  failed 
tc  cofrp  I  ete  I  y  suppress  the  background  of  the  figure,  .  The^short 
horizontal  line  In  the  lower  right  corner  Is  due  to  errors  m  the 
Tv  Input  hardwar*. 


The  Image  of  Figure  4,3  contains  100  I a§e \ aces •  i®7Z7  522" 
zero  brightness  samples  war6  detected,  and  4956  remained  after 
thinning,  The  program  required  8  minutes  of  elapsed  time  to  scan 


the  scene,  and  1  minute,  18  seconds  of  CPU  time,  The  8  minute* 
includes  some  time  for  user  Interaction  with  the  program,..  A  one- 
saconc  settling  time  Is  Imposed,  after  each  step  of  the  rotating 
ir  |  r  ror ,  for  persistence  on  the  vldlcon  to  die,  but  this  Is  partly 
overlapped  with  orocesslng  time,  The  balance  of  tha  time  not 
accounted  for  by  computation,  waiting,  or  Interaction  Is  due  to 
time  sharing  on  the  computer.  The  tnlnnlng  operation  reoulred  39 
seconds  of  CPU  tlms  additional.  The  program  which  accomplishes 
this  runs  In  27K  of  core  on  the  PDP-10  computer, 


4,2  LINKING  THE  POINTS 


Th?  cenj;erj|ne 


points  resulting  .from  the  line  thinning 
operation  (Section  4.15  are  stored  In  the  data  structure  In 
raster  order,  that  Is,  they  ar«  sorted  by  their  coordinates.  In 
oroer  to  separate  line  segments,  perform  curve  fitting,  eliminate 
spurious  points,  and  provide  a  more  useable  structure  to  the 
data,  contiguous  seauences  of  points  must  be  Identified  as  lines, 
and  the  points  sorted  In  order  along  these  lines. 


The  points  are  linked  by  a  "max 
This  Is  akin  to  finding  a  m|n 
contiguous  or  nearly  contiguous  do.  _  . 

Path  In  this  tree.  Because  of  the  linear  nature  of  our  data 
points,  we  may  take  some  heuristic  snort  cuts. 


mal  minimum  distance"  method, 
mat  spanning  tree  linking 
nts,  and  finding  the  longest 


To  do  this,  we  first  shall  define  a  "minimum  distance" 
between  two  points  In  a  contiguous  set  corresponding,  to  tne 
shortest  path  through  the  set  which  link  the  two  points,  The 
"end  points"  of  a  contiguous  set  are  the  pair  of  points  which 
have  the  greatest  minimum  distance  between  them.  The  linking 
routine  orders  the  oolnts  of  the  set  according  to  the  shortest 
Path  between  the  end  oolnts,  and  deletes  those  oolnts  of  the  set 
'•hlch  do  not  Me  on  this  oath, 
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w#  define  a  minimum  distance  function  as  follows:  Between 
ar.y  two  nelghbortn9  Oolnts»  t^e  "po I n t-to«Po i nt  distance”  l9 
difinad  In  Table  4,1  (Two  points  are  neighbors  If  and  only  If 
there  Is  an  entry  in  the  table  corresponding  to  their  relative 
looatlon,)  For  any  two  points,  not  necessarily  neighbors#  a 
"path  distance"  may  be  found  by  summing  the  po 1 nt-to-oo I nt 
distances  over  some  ne I ghbor-to-ne I gnp  Jr  oath  connecting  the  two 
oolnts,  In  Figure  4.4#  A#  3#  and  C  paths  connecting  ooints  o 
and  a*  oor resoond I ng  to  oath  distances  of  7#  6#  and  7,_  The 
"minimum  distance"  between  two  oolnts  Is  the  minimum,  over  all 
oaths,  of  tne  Oath  distance  between  them,  In  Figure  4,4  the 
minimum  distance  between  P  &od  o  Is  6,  corresponding  to  oath  B, 

6  5  4  5  6 

5  3  2  3  5 

4  2*24 

5  3  2  3  5 

6  5  4  5  6 

Table  4,1 

Polnt-to-Polnt  Distance  (From  Center  Point) 


Figure  4,4 
Some  Dath  Distances 


To  find  the  end  Dolnts  we  take  the  first  point  on  the  list  a? 
a  starting  point#  and  conpute  the  minimum  distance  to  every  other 
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4,2 


Dolnt  to  which  a  oath  exists,  (By  considering  the  nearest  oolnts 
flr-t#  t^*  t'm®  to  compute  th*s*  d Istances  Is  DrODOfUonal  only 
to  tha  number  o f  points,)  Assuming  there  are  no  long.cl rcular 
oaths,  (and  the  natur*  of  our  data  ereelude*  this#)  the  oolnt 
with  the  greatest  minimum  distance  from  the  starting  oolnt  must, 
b#  one  of  the  end  oolnts,  (See  Figure  4.5.)  Taking  this  end 
oolnt  as  a  new  starting  Dflint#  we  again  compute  the  minimum 
distance  to  every  other  Point#  to  Identify  the  other  end  Dolnt, 
(Figure  4.6.) 


After  one  pair  of  end  oolnts  hae  been  foynd.  the.  oolnts  op 
the  minimum  oath  are  cooled  Into  a  eeoarate  array  In  their  order 
along  the  oath,  All  oolnts  to  which  a  oath  exists  but  which  do 
not  lie  on  the  minimum  oath  are  to  be  considered  as  noTee#  and 
the  entire  contiguous  set  of  data  points  Is  deleted  from  the 
list,  The  process  Is  repeated  to  find  other  line  segments  until 
no  points  remain  unaccounted  for,  Segments  containing  fewer  than 
f | ve  points  are  discarded  as  spurious,  The  linked  points  In  each 
line  segment  are  then  passed  on  to  the  segmentation  and  curve 
fitting  routines, 


The  point  linking  routine  found  two  lln 
of  Figure  4,2,  These  two  lines  are  shown 


e  segments  In  the  data 
In  Figure  4,7,  A  gap 
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i 

l 


FI aur«  4,6 

Locating  the  Other  End  Point 


Figure  4,7 

Two  Linas  round  oy  the  Ltnwing  Algorithm 


LINKING  THE  POINTS 


4,2 


In  the  points  along  th*  thlgn  of  the  doll  prevented 
laentif!eatlon  of  th#  tract  as  a  single  line.  Figure  < . 8  shows 
the  traces  of  Figure  4,3  aft*r  the  linking  operation, 
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Figure  4  f  8  \ 

Multiple  Laser  Tracts  of  a  Rarai*  Do  I  I  After  Linking 


4,3  RECURSIVE  SEGMENTATION 


The  next  steo  in  the  doscr'ctlon  of  objects  is  curve  fittino 
<f  the  laser  data.  For  esc*!  line  segment  found  by  the  sorting 
Cceretlon  (Section  4,2)  a  curve  or  set  of  curves  is  found  which 
nay  represent  or  approximate  the  oolnts  along  the  line  segment, 
c|v|fl|ng  the  segment  into  subsegments*  as  necessary*  to  obtain  an 
*G0Quate  aop r ox l mat i on , 

Th«r«  ar«  several  advantages , to  curve  fitting  the  data.  One 
c  o  v I o  u  s  advantage  Is  a  comoresslon  of  the  gross  amount  of. data 
which  must  be  handled*  a  compression  usually  of  about  4  to  1, 
Curve  fitting  smooths  the  data  and  rejects  soUrious  points.  The 
* e9mentat i on  necessary  for  curve  fitting  Is  useful  in 
feaner. ration  of  objects,  And  the  more  richly  structured  data 
Case  of  curves  facilitates  further  processing.  However,  it  is 
time  consuming,  and  It  Introduces  a  certain  amount  of  systematic 
* r ror , 


Segmentation*  at  the  present  status  of,  our  experimental 
research.  Is  used  orfmarlly  to  assure  a  good  fit  to  the  data  of 
the  fitted  curve  segments.  He  have  found  that  the  methods  we  use 
« r 8  accurate  In  locating  corners  In  lines,  or  other  abruot 
chanfias  In  characteristics  (see  Figure  7,1),  Corner  data  are 
rot  Presently  used  b>‘  our  programs*  but  w |  I  |  be  useful  when  this 
research  Is  carried  further, 

Curve  fitting  and  segmentation  Is  done  in  TV-  raster 
coordinates*  before  any  use  Is  made  of  the  calibration 
Information  to  obtain  depth,  Whether  this  takes  Dlace  before  Or 
after  conversion  to  three  dimensions  is  only  a  minor 
consideration,  Tne  transformed  data  are  planar  for  each  lase? 
scan*  and  fittln9  could  also  take  Place  In  a  coordinate  system 
aligned  on  the  olar-e  of  light  which  llluninates  the  scene.  The 
Principal  reasons  we  have  chosen  to  segment  and  fit  in  two 
dimensions  are  that  the  data  structure  is  simpler  in  two 
dimensions,  and  that  transf ornat I  on  of  the  oarameters  of  the 
curves  to  three  dimensions  reaulres  less  orocesslng  than 
transforming  the  points  they  aoorox|mate, 

The  next  Section  (Section  4,4)  and  Appendix  B  describe  how  a 
given  line  segment  may  be  represented  by  either  a  straight  line 
or  by  a  general  second  order  curve,  The  curve  fitting  routines 
find  a  curve  which  b*st  fits  the  line  segment*  in  a  least  sauare* 
sens® , 
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The  recursive  seamenter  starts  with  a  line  segment  found  by 
th«  sorting  routine  (Section  4,2),  This  line  segment  Is  Dtssed 
to  curve  fitter  for  fitting  by  a  straight  lino  or  second- 
Gr oe'  curve,  If  the  fit  Is  ac c actable  (see  Section  4,4  for 
Criteria  of  acceptability)#  than  the  routine  exits,  If  not#  then 
the  curve  must  be  broken  into  two  cleees#  and  each  subsegment. 
oass*d  to  the  recursive  segmenter  for  fitting  end,  if  necessary, 
further  segmentation,  After  the  two  subsegments  have  been  fit, 
If  either  of  thg  subsegoents  r eau i r ed  further  segmentation,  than 
an  attempt  Is  mace  to  "erge  the  t*o  sub-subsegments  on  either 
sloe  of  the  original  break,  figure  4»5  Illustrates  this,  If 
Merging  falls  or  ]s  unnecessary,  It  Is  determlnad  whether  a  shift 
•  r.  either  alrectlon  cf  the  point  of  segmentation  will  result  In  a 
3fctt*r  overail  fit,  as  snown  In  Figure  4,12* 


Segmentation  made 


Figure  4,9 

Merging  of  Cur  ve  Segments 


Two  tests  determine  the  oolnt  at  which  a  line  segment  Is 
brokenj  Inflection  and  maximum  excursion,  A  "basal ino"  Is  drawn 
hetwetp  the  end  Doints  of  the  line  segment,  If  the  segment  Is  S- 
snapac,  <l,e,,  contains  an  inflection  ocint  or  change  In  sign  of 
curvature,)  then  the  segment  Is  broken  at  the  point  where  it 
crosses  the  bast'ine,  Otherwise  it  is  broken  at  the  point  where 
It  attains  Its  maximum  excursion  from  the  baseline.  Figure  4,11 
end  Figure  4,12  Illustrate  tnese  two  metnods  of  segmentation, 
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CURSIVE  SEGMENTATION 


Routines  will  shift  point  of 
segmentation  in  order  to 
improve  overall  fit 


FlflUr® 

gh | f t  of  segmentation  Point 


Figure  *»11 

Segmentation  at  Inflection  Point 
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Figure  4,12 

Segmentation  at  a  Maximum  Excursion 


4,4  CURVE  FITTING  SUBROUTINES 

Ip  every  case#  an  attemot  Is  mad*  to  fit  aacn  line  siomant  by 
a  straight  line  before  trying  any  higher-order  curves,  A 
straight  line  ts  presented  by  the  equation 

Ax+8y+C=0,  CEquatlon  4.10 

For  a  given  line  se9ment«  the  constants  A,  B»  and  C  are 
determined  by  the  method  of  Section  5,3  of  Aooendix  B,  The  data 
structure  for  a  straight  1 < ne  contalns  the  valu#s  of  th# 
constants  A,  B,  and  C,  and  the  coordinates  of  the  two  end  ooints 
c f  the  !  I n«  segment , 

fit  of  a  straight  line  Is  acceotable  If  the  RMS  error  of 
Is  below  a  certain  threshold,  If  the  Individual  error 
(a  x  ♦  B  y  *  C)  for  e*ch  point  is  below  another  threshold,  and  if 
there  exists  no  systematic  deviation  from  linearity  of  tha 
ooints,  a  systematic  deviation  from  linearity  Is  detected 
whenever  five  consecutive  ooints  Me  on  the  same  side  of  the 
"best  fit”  Mne,  (In  the  case  wner*  the  number  of  ooints  in  a 


the  f|t 


5ii 
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4.4 


i i n«  segment,  N,  Is  less  than  t«n»  the  number  of  consecutive 
points  necessary  is  N/2.) 

A  genera!  second  order  curve  may  ba  represented  either  in  the 

form 

2  2 

Ax  +  B  x  y  C  y  +  Dx  +  Ey  +  Fs0 

^Equation  4,23 

cr  in  the  form 

2  2 
x'  y' 

+  -----  -  i  CEauation  4.3] 

M  m 


where  x'  s  (x  -  X  )  cos  0  +  <y  -  Y  )  sin  9 

c  c 

y'  5  (y  •  Y  )  cos  8  -  (x  -  X  )  sin  8 
c  c 

Equation  4,2  Is  usefu|  for  determining  the  goodness  of  fit, of  the 
curve  to  a  data  point  or  the  set  of  data  points.  Eouatlon  4,3 
contains  useful  geometric  Information  about  the  curve.  If  m  in 
Do*it|v«,  Equation  4,3  represents  an  ellipse.  Then  M  and  m  are 
th«  sauares  of  the  major  and  minor  axis  lengths*  respectively*  X 

c 

end  Y  represent  the  coordinates  of  the  center  of  the  ellipse, 
c 

and  8  r®pr*3onts  th»  rot»tlon  of  th«  majo.  axl8  cloekwlse  from 
the  horizontal,  If  m  Is  negative,  Equation  4,3  represents  a 
hyperbola,  and  M,  m,  x  *  Y  ,  and  8  are  Interpreted  similarly, 

c  c 

The  method  of  Section  B,1  finds  five  different  curves  in  the 
form  of  Eouatlon  4,2  which  may  or  may  not  .adequately  represent 
the  set  of  data  Points.  These  five  curves  are  ranked  In  order  of 
goodness  of  overall  RMSt  fit*  and  considered  one  at.  a  time. 
Curves  are  rejected  r.s  u’nacceotab  I  e  If  the  overall  error  of  tha 
f|t  la  too  laroe  or  if  any  Individual  data  point  lies  too  far 
from  curve.  In  addition*  checks  are  performed  to  prevent 

such  misfits  as  those  shown  In  Figure  4,13. 

The  data  structure  for  a  genera!  second  order  curve  contains 
the  s|x  constants  of  Eouatlon  4,2*  the  five  constants  of  Eouatlon 
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4  3  the  coordinates  of  the  end  points  of  the  subsegment,  and 
Ji?;r l«o"°™*.«J  Relative  to  to.  orindoal  axes.  of  too 

oolnts,  In  clockwise  order. 


-he 

6nd 


r  i  r,  r  Art  curves  have  p  f  o  v  e  n  a  not  entirely 

s»t|5fSctoly  Jineaeotattor,  for  ourvfd  lines.  They  are  clumsy  to 
JJnlStTSU'  and  tji  least  souares  orocedure  for  evaluetins  the,, 

?^e  'orvXrl  oribFer,  is  discussed  In  oeta  I  in 
Section  B.5  of  iDc.odix  P.  Sone  alternat;ves  to  general  secc  d 
or'er  curves  for  reorienting  curved  lines  are  oresent.0  in 
Section  B ,  6  In  ACoendi*  I?. 


In  the  case  Cf  the  two  segments  snown  in  Figure  4.7,  the 
following  steps  were  necessary  „o  fit  .hem. 


1,  The  segment  on  the  left  waS  fitted  with  a  hyperbola. 


stra 


jihtT>ltneCorrV|  EecoSd-crdeJ^S^vi?  S°d  wal  sighted  nea? 


ro  ■  a**  w  1  '  ^  1  ~ -  * 

the  middle  of  the  vertical  portion. 


3. 

I  I  ne  and 
4,34  shows 


These  two  subsegments  -ere  f 
a  hyperbolai  without  urther 
affairs  ftt  this 


tne  state  of 


itted  with  a  s 
segmentat i on . 
point. 


:  r  a  i  9  h  t 

Figure 


?h  I  f ted 
fit, 


,T;eo  su: :in°i  KiUJ'Jiit'-’HS-JSMis 


..rbfi'KTlMtft.l’.S.SSKSlUS  a°nd  SlMIlfitSSI  H“?SS 
anSMr  Mni  s.Unts.  notably  around  the  -cists  and  ankles 
been  lost,  because  the  oolnt  sort i ng _ rout i ne  did  not  md. 
contiguous  DQlnts  to  consider  sign.  f. can..  At  Present, 
f|ve  contiguous  points  ere  necessary  for  a  line  segment 
retained,  Many  of  the  shorter  line  segmentate ^  represen 
straight  lines.  At  least  si*  points  are 
solutions  to  the  eigenvalue  equations 
+ » *  r  e  «  of  t.  n 


necessary 
to  exist. 


for  non' 
Sone 
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Figure  4,14 

Curva  Fitting  without  Oct  I n I zat I  on  of 


Division  Point 


F I gur«  4,15 

F I n* I  Fit  of  «  Laser  Tract 


5  FITTING  of  PRIMITIVES 


Ar  essential  crereau  i  s  I  te  of  the  description  of  objects  Is 
the  acuity  to  reccSnlza  and  trace  out  the  Primitives  cf  which 
the  dascrlotlons  are  conocseo,  Tne  Identification  of  ths  ends  of 
thi  Drlmltlves»  the  olaces  whe  o  gross  changes  in  cross  section 
Occur,  aids  In  segmenting  complex  ooJects  into  their  Darts,  This 
chaster  describes  our  methods  for  identifying  and  tracing 
generalized  cyl|n3efs, 


Ideally#  tnese  routines  would  be  used  by  a  higher  level 
orogram  which  makes  hypotheses  about  the  structure  of  an  object, 
=*r.d  calls  the  cylinder  tracer  to  verify  these  assumptions,  The 
structure  and  operation  of  such  a  higher  level  program  is 
suggested  In  Chapter  6.  In  Practice,  an  initial  segmentation  is 
carried  out  for  the  entire  object,  ano  the  user  of  the  oregratr 
may  specify  which  pieces  will  ba  traced, 


The  basic  rode  of  operation  of  the  cylinder  tracer.  Is  to 
accept  an  initial  estimate  as  to  the  location  and  orientation  of 
the  axis  of  a  segment,  and  to  either  Imorove  on  the  estimate,  Or 
estimate  as  not  leading  to  a  plausitle  generalized 
Tne  Initial  Sluess  may  come  from  a  two-dimensional 
the  laser  scans,  as  described  in  Section  5,3,  or  may 
by  a  higher  level  hypothesis  generation  Program  for 


reject  the 
cy I  I  noer, 
analysis  of 
oe  s up p | I ed 


v*>r  I  f  |  cation, 


of 


Ar.  essential  function  cf  the.oYll 
complex  objects,  once  an  inltl 


noer 
a  I  es 


tracer 
1 1  mate 


is  segmentation 
is  verified 


,  .  ,  -  -  -  - -  .  -  ver  i  f  1  ed  as 

be  cnging  to  Dart  of  an  easily  described  cylinder,  the  routine 
trles  to  extend  the  cylinder  In  both  directions.  The  extension 
I5  terminated  where  a  gross  change  of  cross  section  diameter 
occurs,  suggesting  the  existence  of  a  Joint  between  segments. 


Presently  tne  routines  assume  ail  generalized  cylinders  may 
be  approximated  with  circular  cross  sections.  This  Ts  a 
limitation  In  tne  I  mo  I  enentat !  on,  hut  not  in  the  general  method'. 
It  should  be  cossjoje  to  characterize  segments  of  objects  using 
the  circular  assumption,  and  later  to  perform  a  more  soecific 
cross  section  determination.  Alternatively,  the  routines  which 
fit  circles  during  the  cylinder  tracing  could  be  modified  and 
exoandea  to  account  fcr  other  cross  sections,  Section  6,2 
oiscussas  methods  for  and  problems  in  description  of  arbitrary 
cross  sections, 


The  method  is  an  Iterative  one.  Starting  with  so^e  estimate 
of  the  axis  of  a  segment,  cross  sections  are  det.  srminad 
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oe rp«rd i cu I ar  to  thl$  axis.  The  canters  of  the  cross  sections 
*  I  I  I  (hopefully)  represent  an  improvement  on  the  initial  axis 
assumption,  The  m<?thod  is  usually  convergent#  but  if  divergent 
behav|or  is  detected,  steps  may  sometimes  be  taken  to  correct  the 
divergence. 


5,1  CYLINDER  TRACING 


"SrUSS. 

ax '  s  of 


itThe  method 
estimate  o'  tne 
inrProvea  axis  estimate  by  fi 
be rpend I cu I ar  to  the  initial 
circles  to  define  a  new  axis, 


the  generalized  cy  - - -  .  ...... 
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axis,  end  using  the  centers 


d  I  anes 
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A  generalized  cylinder  Is  represented  in  the  Program,  as  a 
seauence  of  points  in  three  dimensions#  denoting  tno  axis  of  the 
cy I  I ncer ,  and  a  l  inear  radius  function  of  the  form# 


RACU)S(n)  S  RAD  I  US  { '<? )  +  M  *  n#  CEauatlon  5 .  il 
where  n  corresponds  to  the  order  of  points  on  the  axis, 

To  illustrate  this  Section  and  the  next,  we  make  use  of  the 
laser  Image  of  a  core.  Figure  5,1  Is  a  composite  of  the  curve- 
fitted  line  segments  obtained  from  the  laser  traces.  Calibration 
data  is  us«d  to  convert  eacn  line  segment  into  a  space  curve  in 
three  dimensions,  #,e  may  compute  how  these  segments  win  appear 
If  viewed  from  some  Dolnt  In  space  other  than  the  TV  lena  center, 
obtaining  the  sloe  view  of  the  cone  shown  in  Figure  5,2.  The 
remalroer  of  the  figures  of  the  cone,  in  this  Section  and  the 
n*xt,  are  also  side  views. 


Figure  5.3  shows  an  initial  estimate  of  the  axis  of  the  cone, 
euopMed  oy  the  preliminary  sedmenter  (section  5,3),  The 
ecPrOximate  outline  of  the  cone  is  sketched  on  the  figure  for 
ciarlty, 


To  improve  on  the  initial  estimate#  the  following  steps  are 
•x«cut*d: 

1,  For  e*ch  point  on  the  axis#  a  cross  section  plane  is 
determined  normal  to  the  axis  direction,  as  exolainec  below, 

,  2,  For  ea£h  plane,  points  on  the  surface  of  the  object 
In  tne  vicinity  of  the  olane  are  found.  Section  5,4 
describes  h0w  these  points  are  found. 


.1 


C'i'L  I N-Er  TRAC|NG 


F I 3Ur 6  5,3 

t  Initial  Axis  Estimate 


3,  From  the  points  fou^d  in  step  2,  a  preliminary 
estimate  of  *ne  radius  and  center  of  the  (circular)  cross 
section  are  ootalneo,  as  descrioed  in  section  5.5,  Figure 
5,4  shows  tne  circles  obtained,  snown  In  perspective  on  their 
respect i ve  Dianes, 

4,  The  raoius  function,  Equation  5,1»  is  oeternlnea  from 
a  least  sauares  fit  on  the  radii  founa  1  r.  steD  3, 

5,  Using  the  results  of  step  4,  circles  of  procer  radi] 
ar«  fitted  to  the  points  found  in  step  2.  A  steepest  descent 
anorithm,  audme-teo  ny  .j9Wton's  method;  finds  the  center 
coordinates  wnlch  minimize  tne  mean  sauare  distance  of  the 
surface  points  fron  the  circle.  Figure  5,5  shows  the  new 
circles  fit. 

6,  Flxuos  ar6  made.  If  necessary. 

The  canters  of  the  circles  fitted  to  the  sur f ace . shou I d 
represent  an  ircroved  estimate  of  tne  axis  of  tne  meneralited 
cy l i ncep , 
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5,1 


CYLlNrE-  TRACING 


A  quadratic  smoothing  function  is  use-1  to  estimate  the 
tangent  t°  the  axis>  for  orientlng  ^he  croSs  sect'On  olane  of 
s t e o  1,  Five  sequential  points  «fO  transformed  Into  a  two 
dimensional  coordinate  system  for  least  ssuares  fitting  oy  a 
oaraboia,  The  tangent  to  the  parabola,  at  tne  coin*  through 
which  we  wish  tne  cross  section  Plane  to  Dass,  is  transformed 
03CK  Into  three  dimensions.  The  cross  section  olane  is  taken 
normal  to  the  tangent  direction. 


with  a  well  oefined  generalized  cylinder  to  trace,  and  in  the 
absence  of  other  nearby  surfaces,  tne  method  usually  converges 
raolojy,  2ut  when  an  error  is  mad3  in  *  I tt i ng  one  cross  section, 
the  error  njst  be  detected  and  corrected.  or  subsequent 
applications  of  the  curve  tracer  tc  s">e  axis  estimate  will 
civerge  to  an  Incorrect  or  meaningless  answer.  Several  tyoes  of 
errors  are  checkeq,  and  corrected  wher  possible. 


The  ends  of  cylinders  are  checked  first.  The  ends  are 
susceqtlole  to  errors  when  extension  of  a  cylinder  has  been 
termlratec  because  of  gross  cross  section  changes.  A  new  axle 
estimate  at  the  and  may  cause  part  of  tne  cross  section  at  th« 
enc  tc  Include  the  wrong  element.  If  the  diameter  of  the  end 
cross  section  does  no*  agree  (within  a  certain  limit)  with  that 
oredlcted  by  the  radius  function  Ecuatlon  5.1.  or  5*  the  axis 
makes  a  share  bend  at  the  end,  the  end  coint  of  the  axis  is 
deleted  from  the  uylircer. 


For  each  inte*’or  oolnt  on  the  axis.  the  diameter  of  the 
cr°ss  section  is  cnnqked  against  t-mat  Dredicted  by  the  radius 
function,  The  a^gle  made  by  that  ooint  and  Its  two  adjacent 
Dc>nts  Is  also  cneqkad;  an  error  exists  if  tnls  angle  Is  less 
tnan  00  degrees.  If  an  error  Is  detected,  a  new  cross  section 
plane  1$  specifies  midway  between  the  two  adjacent  axis  oolnts. 
The  Parameter  GAP,  whicn  controls  the  cross  section  determination 
( s ® e  section  5,4),  is  °i*her  Increased  or  decreased,  depending  on 
whether  the  diameter  estimated  cy  Section  5,5  is  smaller  of 
larger  than  the  orenicted  diameter.  The  new  cross  section 
replaces  the  old,  and  tne  raJiJS  function  is  recomputed. 


5.2  EXTENDING  Th£  CYLINDER 

Usually  an  initial  axis  estimate  includes  only  a  short 
sect!on  of  a  longer  Piece  that  may  be  described  as  a  generalized 
cyllhoer,  Extending  the  axis  estimate  finds  the  longest  possible 
cyllnqtr  that  may  be  conveniently  described,  a"d  aids  In 
segmentation  of  comoiex  objects  by  locating  gross  changes  In 
cross  section  diameter  of  an  object. 
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EXTENDING  THC  nYLi^P 


5.? 


Extension  Is  ♦ro"1  one  and  at  a  tins.  rrom  one  end,  the  axis 
l$  extended  a  fixed  distance  (determined  by  tne  average  3Dacina 
between  planes  in  the  Original  axis  estimate)*  and  a  'igle  new 
circle  added  to  the  cylinder  description.  following  steps  1 
through  3  of  Section  5,1.  A  circle  of  radius  determined  by 
Equation  5,1  Is  fitted  to  the  cress  section  coints,  as  In  step  5, 
*s  long  as  the  extension  Is  comoatlble  with  the  rest  of  the 
generalized  cylinder,  additional  extensions  are  made, 

I ncompat I b I | I ty . of  an  extension  wltn  the. rest  of  tne  cylinder 
i^av  he  signalled  either  by  a  share  oend  in  the  axis  as  a  resuit 
of  the  extension,  or  by  disagreement  between  the  circle  radius 
estimated  by  the  method  of  Section  5,5  and  the  radius  function 
EQtiatlon  5,1,  (For  our  purposes#  the  radii  agree  If  their  ratio 
Is  between  0,66  and  1,5.) 

When  a  disagreement  or  anomaly  is  detected,  new  constants  are 
determined  for  the  radius  function  of  Equation  5,5.,  by  repeating 
steps  4  and  5  of  section  5.1,  ana  the  extension  attempted  again. 
If  the  disagreement  persists,  the  entire  axis  estimate  obtained 
up  till  now  t3  reprocessed  by  the  cylinder  tracer,  and  the 
extar-alon  attempted  once  again,  (Tne  finding  of  cross  section 
Points  Is  time  consuming,  This  Is  why  a  fixup  to  the  radius 
function  Is  tried  nefore  the  entire  axis  is  reprocessed ,  >  If  the 
attempt  to  extend  the  cylinder  aflaln  fails#  then  extension  is 
abandoned,  and  extension  Is  started  from  the  other  end, 

f  I  rs^*ex?endf»3*dtowar 9  lUrnBl|0M8!.rih,5^!'vliustSl':Siagu?S 

analysis  of  the  cone  after  extension  from  both  ends. 
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EXTENDING  TUE  CYLINDER 


<r  -  zr> 


c _ •  ~~r> 


F I 5u r ®  5,6 

Come  I  9t®  Cone  Ana  |  y3  I  s 


5,3  PRELIMINARY  GROUPING 

An  initial  ?rouolno  and  segmentation  Is  carried  out.  on  an 
Iirage  to  Identify  candidates  for  r«Dr  asentat  I  on  bv  generalized 
cylinders#  and  to  syooiy  an  inltlil  estimate  to  the  cylinder 
tr«c«r  and  extender, 

This  Initial  glueing  Is  carried  Out  In  TV  raster 
coordinates#  before  conversion  of  the  fitted  curves  to  three 
d|rrens|onst  Segments  of  laser  traces  whJeh  are  adjacent  and 
Parallel  are  linked  together  to  forr>  "groups",  The  midpoints  of 
the  segments  nak]ng  ud  a  group  will  be  the  orellminary  axis 
estimate  suoolled  to  the  cylinder  tracer. 

Figure  5,7  sho*s  the  grouts  extracted  from  the  :~age  of 
Figure  4,16,  DMy  the  deoth  discontinuities  detected  oy  tne 
Point  linking  routine  (Section  4.2)  are  considered  to  segment. 
■aser  traces}  the  segmentation  Derformeo  for  curve  fittinq 
(Section  4,3)  Is  disregarded,  For  tne  DUrDOses  of  preliminary 
Sr°uh!pi8;  each  segment  of  a  laser  scan  is  represented  as  a 
straight  line  joining  the  enr  points  of  tne  segment. 
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PRULIMNARY  GROUPING 


5,3 


Figure  5 ,  S  clots  the  midpoints  of  the  segments  shown  in 
Figure  5,7,  wnlch  w] | |  be  transformsd  Into  throe  dimensions  end 
used  as  preliminary  estimates  for  the  cylinder  tracer  and 
extender , 

The  basic  method  of  preliminary  grouping  is  to  link  together 
line  segments  from  consecutive  laser  scans  on  the  basis  of 
whether  or  not  they  are  roughly  parallel  in  their  TV  Images. 
Segments  from  consecutive  laser  scans  are  linked  together  by  the 
following  test,  The  end  points  of  each  segment  are  Joined  by  a 
straight  line,  if  the  reroend icu lar  bisector  of  the  first  line 
intersects  the  second  line  between  Its  end  Doints,  and  the 
perpendicular  bisector  of  the  second  similarly  intersects  the 
first,  tnan  the  lines  are  "approximately  parallel",  and  are 
linked  together,  If  any  line  segment  can  be  linked  to  either  of 
two  segments  In  any  one  laser  scan,  then  no  linkages  ar«  made, 
Ficure  5,9  shows  some  examples,  Lines  1,  3,  and  5  will  be  linked 
together,  as  will  lines  2,  4,  and  6,  and  lines  7  and  8,  No 
linkage  may  be  made  between  lines  5  and  7,  because  the 
perpendicular  bisector  of  line  7  does  not  Intersect  line  5, 

A  «et  of  segmerts  linked  together  Is  a  "group".  A  check  is 
n-aae  for  gross  changes  Ip  the  leneth  of  segments  maklng  u0  the 
croup.  if  such  a  change  Is  oetect«d*  the  group  is  divided  at  the 
o i sccrt i nu I ty , 


All  groupings  are  extracted  simultaneously  in  a  single  pass 
through  the  data  structure, 

a  rough  estimate  of  the  radius  of  each  cress  section  is 
reouired  for  the  cross  section  point  f  I  rid©  p  (Section  5,4),  This 
inlt'al  estimate  is  computed  from  the  length  of  each  line 
seomert,  and  the  angle  the  seonemt  makes  with  the  line  I  inkino 
the  midpoints. 


5.4 


LOCATING  CROSS  SECTION  POINTS 


The  cross  section  finder  locates  Points  on  the  surface  of  an 
object  in  the  vicinity  of  a  n  lane  cutting  the  object.  Since  one 
plane  nay  cut  a  complex  object  at  several  Places,  it  is  necessary 
to  separate  the  Points  corresponding  to  the  generalized  cylinder 
being  considered,  from  those  that  may  belong  to  another  nart  of 
the  object. 

The  cross  section  finder  regyires  the  coordinates  of.  a  olane 
(in  three  dimensions)  and  an  estimate  of  the  center  and  radius  of 
the  circular  Cross  section  It  is  to  find, 

Twc  auxiliary  dines  are  introduced,  parallel  to  and  on 
0ither  side  of  the  cross  section  plane.  The  distance  between  the 
cross  section  plane  and  each  auxiliary  plane  is  controlled  by  the 
distance  between  consecutive  points  on  the  axis  being 
investigated,  nov,  every  curve  segment  obtained  from  the  range 
oata  is  examined  to  see  if  some  oortton  of  it  lies  between  the 
two  auxiliary  Dianes.  (Examining  the  coordinates  of  the  end 
ao'n-^s  of  each  £egment  eliminates  nOst  of  the  segments  with 
little  computation.)  If  some  portion  of  a  curve  segment  lies 
between  the  two  auxiliary  Hanes*  the  intersections  of  the 
segment  with  tno  auxiliary  plane  are  entered  into  a  list  of  cross 
section  points,  jn  a  two  dimensional  coordinate  system  on  the 
cross  section  plane.  If  the  angle  at  wh|ch  the  curve  segment. 
Intersects  the  auxiliary  Planes  Is  small,  intermediate  points  are 
also  entered, 

Figure  5, IK  plots  the  cross  section  points  found  In  a  cross 
section  across  the  body  of  the  doll  shown  In  Figure  5,25.  (The 
Points  are  viewed  as  if  we  were  looking  at  the  cross  section 
Plane  from  near  the  feet  of  the  doll,)  Note  the  group  of  points 
to  the  left  of  the  main  grouo  of  points.  These  correspond  to  the 
right  arm  of  the  doll,  (T'-e  reason  for  the  rather  wide 
scattering  of  tnese  points  Is  discussed  In  Section  5.6.)  The 
cross  section  finder  must  now  seDarate  these  two  grouDS  of 
Points,  based  on  the  supplied  estimate  of  the  radius  and  center 
of  the  circular  cross  section. 

The  cross  section  points  ace  linked  .togetner  Into  groups 
(equiva|ence  classes)  un  *h€  basis  of  DPoximlty  to  on®  another, 
a  tnreshold,  GAP,  determines  the  maximum  distance  between  Dointr 
to  link  them  into  the  same  group.  The  default  value  for  GAP  is 
determined  by  the  nean  distance  between  consecutive  laser  traces, 
but  may  be  modified  by  the  cylinder  tracer  (Section  5,1)  to 
corr®ct  er rors. 
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5,« 


F  ,8Urf*  5,12 
Crass  Section  Points 


Th,  Jp  th*  PO^ts  of  Figure  5',1Z,  i 
The  Oroup  cor resoond ) na  tc  the  doll' 
distance  criterion#  leaving  the  point: 


3 r o u d s  were  identif 
arn  was  rejected  oy 
hown  in  figure  5. 11. 


•  d. 
the 
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5.4 


Figure  5,11 

Cross  Section  Points  Retained 


5.5  FADI  JS  AN!D  CENTER  ESTIMATION 

This  Section  describes  how  the  Known  Placement  of  the  laser 
and  Tv  camera  may  oe  used  to  estimate  the  radius  and  center  of  a 
oartlcular  cross  section. 

Given  a  circular  cylinder  witn  a  straight  axis,  aoDroxlmate  |y 
ha • f  of  Its  surface  will  be  visible  when  viewed  m  ordinary 
1 1 'urination  by  a  television  camera,  When  the  same  cylinder  is 
Illuminated  by  a  oolnt  source  of  light  located  at  the  laser 
center,  approximately  half  of  tne  surface  will  be  illuminated. 
The  raalus  end  center  estimation  is  based  on  the  amount  of 
overlap  between  the  Illuminated  area  and  the  visible  area. 

The  estimation  Is  based  on  tne  following  assumptions? 

1,  That  the  surface  we  are  exanining  may  be  aoproxinated 
by  a  circular  cylinder, 

2,  That  the  cross  section  Diana  whose  radius  we  are 
estimating  is  normal  to  that  cylinder# 
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RADIUS  a.ND  center  estimation 
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5.5 


The  Iterative  nature  of  the  cylinder  finding  GDeratlon 
Guarantees  that  if  cylinder  finding  converses,  then  the  cross 
section  planes  will  aDdroach  being  normal  to  the  axes  of 
c  >  I  i  n  (i  9  r  s  , 


Tfe  clstance  from  the  laser  to  tne  object  begin  scanned  Is 
tycically  abnut  3?  Inches,  Cross  sections  of  cylinders  seldom 
exceec  i  Inch  in  radius.  The  error  Introduced  by  assumotion  3  is 
net  mere  than 


sin  (1  inch  /  32  Inches) 
or  about  three  Decent. 

The  errer  Introduced  by  assumotion  4,  that  laser  _ lines  are 
aetected  In  tne  entire  area  which  is  visible  and  Illuminated,  is 
tne  most  difficult  to  estimate,  Wnen  a  laser  trace  illuminates  a 
Cylinder,  the  «nd  of  the  las^r  trace  becomes  dimmer  and  dirmCf  a; 
't  approaches  the  ijr}*  of  illumination.  There  "’ust  always  exist, 
seme  area  of  the  cylinder  In  which  laser  traces  may  fall*  but 
w;i|  oe  below  tha  brightness  threshold  of  detection,  The  width 
of  this  uncetectafc  1 2  orea  w|l|  depend,  among  other  things,  on  the 
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brightness  of  the  laser  bean,  tne  color  of  the  object*  tne 
ceOgl^iyl^y  of  ca'iera,  ano  r^e  o  r  i  enra^  i  rn  of  xhe  cylinder 
'*ith  rasoect  to  tne  laran  lr  one  test#  a  detected  laser  trace 
v,an  twe|v^  percent  snorter  than  it  snould  have  nean  If  tne  entire 
tr<*ce  were  un  I  f  o  rm  •  y  bright,  nut  naoause  of  the  variable  nature 
of  this  error,  it  remains  tne  largest  single  contributor  to 
uncertainty  of  radius  estimation. 


o,6  SOME  -ESULTt 

Ou  routines  tens  to  do  we  |  I  on  objects  descr  i  wa:*  I  a  as  a 
single  generelizeo  cylinder,  and  cn  portions  of  complex  objects 
wnich  possess  ccnsijjerao!e  elongation,  They  give  marginal 
results  In  the  ne  i  ohbc  rbooc  of  T-Joints»  and  wrier?  nearby  carts 
confuse  t  n  o  cross  section  finder, 

The  results  Pictured  In  tn i s  Section  were  obtained  w.th  some 
decree  of  manual  direction  cf  the  Program's  execution.  It  was 
neoassgrv  for  tne  operator  tc  specify  wniph  areas  of  tns  aicture 
tc  3ra|yze,  and  to  interpret  the  *esuits  as  to  success  or 
f  a  I  lure. 

This  procedure  c°uld  be  carried  out  completely  unl8r  orcgram 
ccntrcl,  given  a  routine  to  detect  overlap  of  oroposeo  axis 
segments  with  Previously  Identified  cylinders,  and  a  routine  to 
oeterrrlne  success  or  failur*  of  ar  analysis,  letectinj  overlap 
reaulres  only  a  two-d  i  mens  I  or<a  I  neo  of  the  ]na3a.  An  incorrect 
analysis  Is  Indicated  by  circle  diameters  rany  times  larger  Or 
scalier  than  those  initially  predicted,  and  axis  Doints  which  do 
not  Occur  along  any  well-defined  curve, 

Ir  9rde^  to  Present  an  unbiased  picture  of  tne  caoao l I i t i •» 
a n a  limitations  of  our  program,  the  results  Presented  here  were 
all  obtained  with  the  same  version  of  the  analysis  program.  Some 
improvement  In  tne  results  night  be  exoeeted  by  adjustinq 
cara^eters  to  giva  the  oest  results  for  each  particular  picture. 
For  each  Image  *e  nave  analyzed,  w9  nave  at  least  once  obtained  a 
better  analysis,  Sut  th*  results  shown  here  were  obtained  ;n  the 
same  evening,  with  no  adjustments  between  one  Dicture  and  the 
next. 


Figure  5,13  is  the  processed  Image  of  a  snake  made  of 
modelling  clay,  rroT  an  initial  a*is  estimate  comprising  perhaps 
the  middla  third  of  the  figure,  t^e  conoiete  analysis  of  Figure 
n,14  was  obtained  by  extension  of  the  ends. 


sc*t  results 


Figure  5,13 
Snake 


Figure  5,14 
£<Ta|ysls  uf  3na<e 
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s^-:  results 


Figure  e'.i5 

Torus 


A  torus  (actually,  a  tathtub  toy)  is  deoicted  in  Figure  5.15. 
The  Irit'a1  axi3  segne*it  which  was  aligned  tne  nignest  value  was 
Ir.  the  lowar  Dart  c f  too  figure,  Extension  was  necessary  from 
or.e  end  only,  r es  J 1 1 1 ng  in  the  representation  shown  in  Fi3Ur» 
5, lo,  The  Dr05ra.r.  cetseted  thf.t  a  closed  curve  had  been  traced, 
ard  'nat  extensior  fro'”  tnp  otner  «no  was  not  necessary. 

When  tne  analysis  wa$  trl63  on  the  tgY  hanngr  of  Fjgute  5.17 
the  result  was  the  description  shown  in  Figure  5,1*?.  ”  i  lure  5,lo 
shows  the  sane  description  fron  a  clfferent  viewing  angle,  three 
axis  segments  were  necessary  to  conolete  the  descrictjon,  one  for 
the  handle»  an-j  on°  on  each  end  of  the  head  cf  the  hnmner.  The 
oesch ict Ion  of  tne  bottom  oart  cf  the  heal  (as  viewed  In  Figure 
n,19)  leaves  fi-.jch  to  be  desired,  Tne  initial  axis  estimate  for 
that  cart  of  tne  inage  followed  for  the  nest  P^rt  the  4iat  end  of 
the  heaflt  Another  case  of  the  cylinder  tracer  would  host  likely 
i-orov#  the  riescr  lot '  on.  If  a  T-Joint  were  detected  in  the 
figure,  and  the  hancl*  deleted  fren  the  data  structure  as 
suggested  In  section  *,i,  an  aceouate  description  would  almost 
certainly  result. 
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Figure  ^ ,13 
Analysis  of  Harrner 


Figure  * , 19 

Analysis  o?  'Wd'mer,  Tod  View 


bCME  RESULTS 
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frequently  nesrpy  parts  of  a  complex  object  causa  the 
analysis  of  an  a*is  segment  to  go  awry,  Figure  5,20  is  the  Image 
of  a  3 1  o  v9  stuffed  wit4’  tissue  oaDer,  and  Figure  5,21  is  the 
aescriotlon  obtained  for  the  glove,  In  the  analysis  of  the  fourth 
f|nger,  pieces  of  the  third  finger  wer*  included  in  the  cross 
sections  found.  The  situation  we  see  here  is  due  to  too  snail  an 
initial  value  for  th9  threshold  GaP  for  the  cress  section  finder, 
when  the  fourth  finger  was  analyzed,  The  snail  value  for  GAP 
allowed  the  axis  of  the  finger  to  be  extended  into  th6  calm  of 
the  glove,  because  cross  sections  across  the  palm  were  broken 
Into  s ma I !  segments,  A5  analysis  proceeded,  the  cylinder's 
radius  function  gradually  became  rather  conical,  When  the  cone 
became  wine  enough  to  Include  the  base  of  the  third  finger, 
segments  from  that  part  were  included  In  the  cross  sections. 

The  palm  of  the  hand  is  not  well  represented  by  a  circular 
cr°ss  section,  In  addition,  the  brightness  of  the  laser,  was  not 
ecJusted  properly,  so  that  sone  of  the  laser  scans  near  the  wrist 
were  not  brignt  enough  to  be  detected.  Nonetheless,  the  analysis 
does  give  a  description  of  the  pa|m  which  is  surprisingly  good 
under  the  circumstances. 

A  toy  horse  js  depleted  in  Figure  5,22.  .  Unfortunately,  when 
the  laser  was  beln?  set  up  to  scan  this  particular  object,  it  was 
not  noticed  until  too  late  that  the  head  of  the  horse  was  outside 
tne  bP|ght  portion  cf  the  |as«r  line,  Consequently  Dari  of  the 
need  Is  missing  ]n  the  Image,  Figure  5,2*  shows  the  cylinder 
analysis  'as  able  to  identify  seven  generalized  cylinders, 
comprising  the  body,  the  neck,  the  tail,  and  the  four  less, 
r I  sure  5,24  Is  a  different  view  of  the  same  analysis  which  shows 
the  neck,  body,  ana  tail  to  better  advantage,  goth  left,  legs  of 
the  horse  are  Partially  occluded  oy  the  shadows  of  the  right 
ie9s,  For  reasons  that  are  presently  unclear,  the  analysis  of 
the  body  failed  to  stop  at  the  rear  legs,  but  continues  to  the 
tall,  (In  terms  of  a  higher  level  representation,  the  extension 
of  th#  body  Is  desirable,  but  the  cylinder  extender  Is  supposed 
tc  stop  whare  a  gross  change  In  cross  section  takes  place,  and 
let  a  n|nher  leva!  routine  decide  if  it  wants  tne  cylinder 
extended ,  > 

In  this  analysis  of  the  horse,  both  right  leg;,  were 
Icentified  sat I s* ac to r 1  I  y .  Put  this  Is  one  of  the  bette^ 
analyses  of  this  image;  usually  only  some  small  length  of  the 
less  is  Identified  before  the  cylinder  extender  exits  with  a 
mismatch,  Our  proSram  Is  poor  at  finding  thin  cylinders,  Some 
'  r  d  !  cs,  *  j  on  of  this  may  o?  seen  i  n  tne  oend  in  the  axis  of  the 
rlsnt  foreleg,  There  are  several  reasons  for  this  deficiency. 


S C K L  Pf.SULTS 
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The  line  linkjng  routine  (Section  4,2)  rejects  short  line 
seSnerts.  The  curve  fitter  cannot  fit  curved  lines  to  sealants 
of  fe^er  than  six  colnts,  Tne  short  lines  tend  to  be  relatively 
noisier,  and  tendto  be  fit  badly  hy  the  curve  fitter.  Examining 
the  lafls  of  Fiaure  5,22,  there  is  much  less  regularity  of  the 
curve  segments  than  in  the  broader  areas  such  as  the  body  or  the 
neck,  And  when  the  cylinder  tracer  searches  for  small  cross 
sections,  there  is  Jess  margin  for  error  In  guesses  of  the 
centers  of  cross  sections.  The  result  of  these  factors  Is  that 
tr.e  cylinder  finder  usually  falls  to  trace  the  comolete  leas  of 
the  horse, 

Ar  example  of  the  noisiness  of  fitted  line  segments  to  thin 
segments  may  be  seen  Tn  Figure  5,13,  where  the  points 
representing  the  arm  of  the  doll  are  much  mc.r9  widely  scattered 
than  those  of  the  body, 

To  fix  this  sort  of  error,  it  wj||  be  necessary  to  fix  the 
Point  linking  routine  to  acceot  snorter  line  segments  (and  to  out. 
u o  with  more  noise  In  the  rest  of  the  Image),  perhaDs  to  modify 
the  curve  fltter,  and  to  allow  for  greater  errors  in  the  cross 
section  flnaer  wh6n  the  cross  sections  being  sought  are  3mall. 


the  5SS4?fAll8S  '5?  r'?hured0IU§l'OW?nei  rout?nEe 

segmentation  between  the  right  leg  of  the  doll,  and  Its  body. 
This  is  the  same  sort  of  error  as  that  which  caused  the  body  of 
the  hcrse  to  extend  toward  the  rear.  The  cylinder  extender 
managed  to  continue  the  analysis  of  the  r  I  Bht  leg  to  Include  the 
f o o t «  Separation  between  the  right  arm  and  the  body  is  good. 
The  head  Is  not  well  described. 


*■'  1 9  u  r  a  4.16  ls  reproduced  as  Figure  5.27,  .The  results  of  the 
analysis  of  this  Dicture  are  shown  In  Figure  5,28,  „  The 
description  of  the  body  is  roor*  because  of  Its  non-cy I  I ndr I ca I 
shape  and  because  the  presence  of  the  left  arm  nearby  confused 
the  cross  section  finder.  There  is  little  separation  between  the 
Ie9s,  but  the  program  found  both  knees,  where  the  separation  la 
greatest.  In  analyzing  tne  right  calf,  separation  between  the 
Ie9s  was  small  enough  to  cause  the  cylinder  finder  to  regard  both 
lePs  together  as  a  single  cylinder.  This  cylinder  was  extended 
upward  toward  the  body,  overlapping  the  previous  analyses  of  the 
kr.e6S,  The  short  cylinder  representing  the  left  arm  's  evidence 
of  difficulty  with  thin  cylinders  first  mentioned  in  connection 
with  the  horse. 
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SO'iE  RESISTS 
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Tha  proflra.-n  which  performs  the  preliminary  analysis  and  the 
cylinder  tracing  and  **xt*ndlnfl  reouires  bet*8®"1  42  and  56  K  of 
core  on  the  POP-iO  computer.  This  Induces  from  3  to  17  Kof 
data  arrays,  11  K  of  d'solay  buffers,  and  7  K  fop  an  Interactive 
cebuog  1  ng*  oacKage,  PAID,  (See  C  Pe  t:  •  t  D  for  a  description  cf  RAID.) 
Simple  figures  $uch  as  the  ring  cp  tne  torus  hay  be  processed  In 
abcjt  one  minute  of  computer  time,  The  hammer  rtauired  two 
*r  i  njtes  to  process,  while  the  horse,  the  giove,  and  both  dolls 
eacn  required  between  five  and  seven  nlnut*s. 


6  DESCRIPTION  OP  OBJECTS 


Th#  state  of  the  e*9er Imenta I  oortlon  of  our  research 
seen  from  the  exa.moies  in  the  preceding  chaDter.  A  great 
work  remains  before  we  may  oroceed  from  laser  data 
arbitrary  real  ooJect,  to  a  fu|!  description  In  terns 
representation,  Tne  material  In  this  chapter  conta 
suggestions  a?  to  how  this  might  be  accomplished  in 
future,  and 
encountered , 


may  oe 
deal  of 
from  an 

of  0>j'r 

Ins  30m« 
*h6  near 


so*ne  of  the  problems  which  will  orooably  be 


The  &r incisal  mode  of  ooeration  of  a  description  program 
should  be  to  build  a  hypothesis  on  the  availaole  data,  test  the 
•ny ootnes  1  e,  and  use  tne  results  of  the  test  tc  build  a  oetter 
hyoothesi#.  The  hyoothesis  generated  will  depond  on  the  data. 
Special  purpose  routines  may  examine  the  data  to  generate 
specific  types  0f  hypotheses.  For  examoie,  a  routine  night 
ocstulnte  the  existence  of  «m?sslnP"  joints  on  an  object  based  on 
relationships  and  on  Proximity*  Verification  of  e 
may  ba  a  slmol*  "ao  -  no  30"  test,  such  as  surface 
?n  tne  Dresent  example,  or  might  yield  additional 
as  the  existence  of  previously  unnoticed  details.  Th# 
the  test.  In  either  case,  should  be  Dlaced  * 
to  enapig  petter  hypothesis  generation  In 


structura I 
hyoothes I s 
contl nu I ty 
data,  such 
results  of 
structure 
I te  r a  t ' ons. 


!  n 


the  data 
succeed i ng 


6.1  LINKING  SEGMENTS  TOGETHER  INTO  A  SKELETON 

5onsJ?SctTis,ofli’ig?i„sa',jh?is,sfiin  *siU  ssu  »f,s?RfcSyiii!di?: 

finding  routines  to  generate  complete  descriptions  of  comolex 
objects.  As  a  first  oass,  some  Joints  between  segments  may  be 
discovered  Immediately,  but  njgher-|eve|  considerations 
concerning  the  structure  and  connectivity  of  skeletons  will 
eventually  have  to  be  considered. 


.  pout '  nf  in  this  and  later  Phases  will  pc  one 
c.neck  surface  continuity  between  two  or  mere  segments, 
analysis  routine  should  select  points  on  the  surface  of  eaci 
segment,  and  the  continuity  routine  should  search  In  a  narro 
oand  batween  the  Points  for  the  existence  and  spacing  0f  lase 
traces,  jf  a  continuous  nath  on  the  surface  is  not  found,  tn 
continuity  routine  should  he  »d 1 3  to  make  small  deviations  *  * 
the  initial  oath.  If  continuity  Is  not  Indicated 

oart  I  cu  I  ar  oa!  r  nf  nnln*c.  *h» 


wain,  toniinui;y  IS  not  1  nd  1 

Particular  pair  of  oolnts*  the  analysis  routine 
Prepared  to  suggest  otner  roint  pairs.  Heuristic 


for 
should 


to 

The 


f  r  Ci 
thl. 


con? I  derat i on 
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6.1 


LI'iki'w  secants  t 


E-)  I  ;  t  r>  a  S-<EL£TO\ 


w I  I  I  dictate  tne  number  nf  point  oairs  to  He  analyzed  cofera 
cof't'rulty  is  rejectee, 


he 


, .  -  easiest 
Cabd !  oates 


LPSt  Jg  i  'US  tc  treat ,  Ml 
.  _  for  th .  s  type  ot  Joint  w 
their  d  r  I  n  e  1 p  a  I  axes  located  close  to 
surface  continuity,  r.ore  than  two 
cont i ru I ty  to  tne  1 o  1  n t  candidate  w|| 
not  of  the  ena-to-end  type, 


epd-to-eno  Joints, 
the  enrj  coints  of 


1  ,  o g  the 
i  I  I  nave 
one  anotner*  and  linked  by 
axis  se3r,ents  w!tn  surface 
I  Indicat3  that  the  Joint  is 


^ i f ur cat  I o is  and  ru 1 1 1 f urcat i ons  will  orcoaoiy  also  ge  easy 
to  recognize,  Tne  conditions  for  a  bifurcation  to  exist  are 
similar  to  tnose  for  an  end-to-eno  Joint.  one  en<  of  one 
sneieton  segment  wj  |  |  *ave  surface  continuity  to  eac*'  of  two 
cther  segments,  tnp  "active"  end  of  the  orlnclbal  segment  lyinq 
between  the  "active"  ends  of  tne  subordinate  segments,  The 
suoordlnate  branches  should  have  cross  sections  of  comcarable 
size. 


T-joints  w ;  |  I  oresent  a  more  difficult  case,  The  initial 
Pass  of  the  cylinder  finder  w|||  not  usually  trace  the  orincioal 
segment  (the  "crcsspar")  through  the  area  of  the  joint,  because 
of  the  aoruut  change  in  apparent  cross  section  w^ere  the 
sudc’c  I  nate  segment  <f>e  "upright")  jcins  It,  Sometimes  the 
Preliminary  grouping  analysis  w|||  miss  one  or  Doth  halvos  of  the 
Principal  segnpnt  on  pither  side  of  the  Joint  we  wish  to  '  I  nd , 
The  analysis  of  tne  hammer,  F'3'Jr»  n,i9  provides  »  good  examole 
of  what  might  pe  expected,  Casa?  wnere  the  crossbar  has  been 
analyzed  as  a  single  continuous  cylinder  will  be  easy  tc  detect, 
Put  Candidates  for  T-Joints  will  also  co-’e  from  cases  where  at. 
least  two  skeleton  segments  are  linked  by  surface  continuity  to 
ar.  area  that  Is  not  oart  of  any  known  skeleton  segment,  what. 
MU  crobably  be  necessary  Is  to  temporarily  delete  frcm  the  data 
structure  any  sKeleton  segment  which  is  suspected  of  celng  the 
"uorlQnt"  of  a  T-joint,  and  recuast  another  analysis  of  the 
suspected  "crossba*-"  fro-'  the  cylinder  finder, 

Perhaps  these  steps  will  orovlc?  all  the  links  necessary  to 
describe  the  complete  skeleton  of  an  ooject,  *:or?  likely,  there 
w|l|  be  areas  of  the  picture  wbicn  have  no  corresponding  sxeleton 
segments,  segments  wltn  suos*antlal  areas  of  overlao, 
Disconnected  fna9ments  of  skeletons,  and  joints  with  ambiguous 
I rte  rpr  etat i ons . 

Of  the  results  presented  in  th8  Drevious  chapter,  r.ho  snake 
ano  tne  torus  will  need  no  further  identification,  rre  hammer 
and  the  9|ove  nign-r  p?  ?ucces?fu|ly  linked  lr»tc  nojeetc  by  the 


LINKING  SEGMENTS  TOgETMF.w  INTO  A  SKELETON 
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simple  methods  we  nave  proposed.  The  horse  and  the  two  dolls 
will  need  further  analysis.  In  the  case  of  the  baby  doll,  we 
(right  expect  the  preliminary  linking  to  correctly  tdentify  an 
epd*  to-end  joint  eetween  the  head  and  the  tody,  and  a  T-Joint 
between  the  left  a-m  and  the  shoulder.  Because  of  the  failure  of 
segmentation  between  the  doll's  right  leg  and  Its  body,  the  left 
lGp  would  dp  Incorrectly  Joined  to  the  body/rlght  leg  in  a  T- 
Jc'nt,  Th*  rlnht  ?.r"  would  not  be  linked  to  any  other  Dart, 


The  next  likely  step  will  pe  to  call 

SU?9eSt  Plausible  !r>  +  «*r>r«  +  atlon<!  for  tn 

suggestions  will 


--  w-  tntu  play  a  routine  to 

interpretations  for  the  data.  Many  of  these 
oe  subject  to  verification  by  the  cylinder 
■ inder  and  the  surface  continuity  routine,  This  routine  might 
suggest  a  T-Joint  between  the  doll's  right  arm  r.nd  the  hio,  and 
reject  that  cn  the  lack  of  surface  continuity,  It  might  suggest 
a  bifurcation  with  the  right  am,  head,  and  body,  but  reject^hat 
hyoothesls  because  of  the  disoarity  between  cross  section  sizes, 

,  .  _  n  «  .  ■  i  -i  -  I  n  o  .  .  1  n  a  r*  *  .  o  M  ><  I  •  f  flP  ■  3  T—  Joint  b  8  t  W  0  C  n  t  Id  0 


It  snou|d  also  suggest,  an* 
riQht  arm  and  the  shoulder. 


If  at  the  end  of  this  analysis  we  have  more  than  one  possible 
analysis  of  the  object,  another  routine  should  rank  order  the 
choices  on  the  basls  of  simplicity  and  agreement  with  the  data, 
ar.a  either  cheose  the  best  description,  or  submit  to  t.we  next 
higher  level  of  control  the  ordered  list. 


£  ,2  CEALJN3  WITH  NON-CIRCULAR  Cr05S  SECTIONS 


sections  If  It  Is  to  deal  with  a  wider  class 


encounters 
"•ore  genera 
of  objects. 


cross 


with  w 
data, 
sections  one 
the  sma | I er 


'll 


,  .  be 
Shn0e 

at  a 
cross 


Many  of  the  c'oss  sections  we  will  be  deal ing 
s  a|l  with  r®soect  to  the  reSolut'on  of  ol,r 
recognition  mav  fee  performed  on  large  cross 
time,  But  to'prooerly  Identify  or  classify 
sections  It  will  pe  necessary  to  consider  several  neighboring 
Planes  simultaneously, 

The  cylinder  fitting  routines  already  lmPl^naonted  take  many 
cross  section  o|anes  Into  account  oy  fitting  each  profile 
I  rd  I  v  i  aua | I y,  then  smoothing  the  radius  function  of  exls  length 
by  a  linear  least  sauar«*  fit.  When  dealing  with  arbitrary  cross 
sections  shapes,  it  may  still  be  possible  in  some  cases  .to  fit 
profile  individually,  and  to  merge  or  check  the  results 


each 
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WITH  !:,'j-rnc.'UR  C*0?s  srCTIONS 


tgt'  s:  n*  Shborlm  cross  sections,  3ut  to  nand  le  cross  section 

r  nai  °r,?orrect|y'f!n  Jenepal  !t  w!"  necessary  to  merge 
he  ra*  profile  osia  oefore  performing  fitting  or  receoniMon 


• ^  »  w  w  *  wrr'Sici'u 

Generalized  translations 
generates  5 


rrtT _Ji°  ^asic  cross. sectl?n  snaoes  wj||  account  for  mes*  of  th* 
coynon  objects  a  recognition  system  nighSVve  V  dial  lit! 

A°^*ly  .  ?^e|  ?uite  successfully  most 


anlnate  objects,  a^d  witn  the  addition  of  rect’-ng  I  es,  wil  I  handle 
a  |arge  number  of  manufactured  objects,  Both  ei|!sses  and 
re  tan-i |e  a  nay  t?  characterized  by  their  major  and  mino^ 
Si'  the,p  an3u 1 f r  orientations  with  resoect  to  the 
I  '  !  2r,Jj|ar  .orientation  nay  be  sDecified  by  the 
< i+ll*  Xl  2  °f  auxi|,ary  coordinate  system  mentioned  in 
•ect  on  2.3,  (Tn;q  |S  tne  first  time  we  have  needed  to  use  this 
fux, iary  coordinate  system,  circles  are  indifferent  *cth* 


,  -  •  u  iiui  «  icr«ni  xnq 

f  r  3u 1  a  r  orientat'c^  of  t*e  axes  on  wnlch  they  are  drawn,) 

3lfflilfi!jren?Jiatin£!Kbet2!“!n  P!!lDses  and  pectandles  will  not  oe 
,  .cult,  for  each  rectangular  cross  section,  either  one  face 

r«a  faces  Of  the  Profile  '-ill  o*  vi3ib|e  simultaneously  to  tne 

.  ep  and  th-  TV  camera,  The  discriminating  routine  w||i  attemot. 

t \ln  °n!f  A  A  =tr?,,aht  l,n3S  «  the  points  of  the  cross 
-TTTifr*  1  u  15  fai  Is,  the  cross  sect  on  will  be  designated  an 


lection  f  ,  .*tr",aht  Mn3S  t0,t:'8  .points  of  the  cross 

»ect  on,  If  this  faMs,  the  cross  section  will  be  designated  an 

Vrl  i;,;*  .  I !?  ty3°  °f  differentiation  is  error  Drone  in 
"■oividual  cases,  but  comparison  with  the  analyses  of  neighboring 
cr*ss  sections  should  cancel  most  errors, 

The  dimensions  of  rectangles,  wnere  *wo  farec  |  *  i  . 

;a;;«  obtained  directly  froS  5*4  cro?s  s e 2? i o n ° ®d P o f T ? e T 
r.  y  one  face  is  visiM«,  higner  level  considerations  will  have 
tc  estimate  the  missing  dimension,  ror  e|!ioses,  ametnod 
S|  i'ar  to  that  Uged  for  estl^atina  the  rani  I  nf  ~ 


-  ■  w-w,  -v  w  •  j  ,  v*  v  i  a  i,  i  u '  i  jj  wiii  nave 

to  esTlmate  the  m-sslng  dimension,  For  e|!ioses,  ametnod 
* '  '  !ap  to  that  Used  for  estimating  the  raoI  I  of  circular  cross 
sections  ( Sect i on  5 , 5 ) ,  nased  on  the  known  oosltlons  of  tne  laser 
V  .c*"’8p?'  w111  3!v-j  the  D  r  1  nc  I  oa  |  dimensions,  ComoaMson 
•  th  neighboring  cross  sections  Mil  reduce  the  errors  involved. 


oherfl  TOpe  3°n  =  ral  cross  sections  must  be  reeeonlzed 

P-The  "l!  tW°  30ss:i\,P  °Ipec*Ions  for  the  analysis  t!  SJSeJld! 
E.ther  the  cross  sect. on  analysis  must  cnoose  among  some  finite 

5P;  ?f  P°s»'Ple  shapes,  or  assumptions  must  be  made  regarding  the 
regularity  of  Shaoe-5  Involved,  The  former  case  is  a  classical 
extern  rocoyntt.cn  rreaie*.  The  pest  approach  to  this  type  of 
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ar.aiysis  would  hs  to  writ**  soec  |  a  | -puppoce  routines  to  isolate 
featur8_  of  the  ci,fVes»  on  which  recognitton  lay  be  based,  In 
the  latter  ease,  some  posslple  regularity  assumptions  are  N»fold 
rotational  symmetry,  and  o!  lateral  symmetry  about  some 
Predetermined  axis,  \f  more  than  one  regularity  assumption  nav 
hold*  the  Program  must  ehoose  which  one  to  aoDly,  based  on 
measurable  features  of  the  shape  of  the  profile, 

Recognition  of  cross  section  snaoes  need  not  be  do^e  in  a 
single  pa35},  4  o  e  |  I  n*  I  *15*  r  y  ana|ys!s  could  assu'r'e  ci.Cyla  c  oss 
sections  to  f}n5  the  skeleton  of  an  object.  Higher  level 
considerations  based  on  analysis  of  tne  skeleton  would  then 
Influence  a  subseauent  detailed  cross  section  examination. 


6.3  separation  OF  OBJECTS  IN  A  SCENE 

Wh«rfi  there  app  multiple  objects  in  a  scene*  the  objects  must, 
oe  separated  one  from  another,  so  they  nay  be  dealt  with 
separately,  Our  existing  implementation  makes  no  attenot  to  do 
th I s»  and  will  deal  only  wi-h  single  objects*  with  the  background 
(th«  tabletop)  suppressed. 

If  the  scene  to  be  analyzed  1$  on  a  tabletop#  calibration 
Information  w|n  gtya  the  homogeneous  coordinates  of  the  olane  of 
tne  table,  The  line  segments  corresponding  to  the  tabletOD  are 
those  that  lie  |n  a*  near  this  Plane,  and  may  be  removed  from  the 
scene  with  no  difficulty, 

Body  separation  may  oe  done  utilizing  depth  Information,  We 
shall  use  the  hypothetical  scene  of  Figure  o.l  to  Illustrate,  An 
edfle  drawing  Is  mad8  of  the  scene*  as  viewed  from  the  yy  camera, 
The  edge  drawing  will  include  only  tne  depth  discontinuities  and 
concave  edges  In  the  scent,  a  deoth  discontinuity  exists  at  each 
of  the  end  points  of  the  line  segments  Isolated  oy  the  point. 
Ilnklrg  algorithm  (section  4,2).  A  concave  edge  point  exists  at 
those  points  where  recursive  segmentation  (Section  4,3'  divided  a 
laser  trace,  and  the  tangents  of  the  ends  of  the  segments  form  a 
concave  corner  (as  seen  from  the  TV  camera),  (It  may  also  be 
necessary  to  consider  all  second  0 r*«r  curves  which  ape  concave 
from  the  TV  camera*  and  denote  a  concave  edge  point  at  the  point, 
of  highest  curvature,)  Figure  6,2  shows  the  deoth  discontinuities 
ar.d  concave  -Jdges  to  b*  found  In  Figure  6,1, 

The  areas  ln§lde  closed  cjrves  may  be  isolated  as  bodies, 
nsura  6,2  contains  tnree  closed  curves  which  isolate  the  ell- 
dlock,  the  cylinder,  and  the  cone. 
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pr*Quently  this  method  will  segment  a  scene  Into  discrete 
bod|e«  that  er«  Dart  of  the  same  ooject,  The  hammer  of  Figure 
5,17  would  be  segmented  into  two  Darts  by  this  methoc,.  The 
segmentation  w| | |  be  useful  In  Identifying  primitives*  but  the 
higher  level  subroutines  should  have  the  option  of  recombining 
Darts,  This  will  ce  possible  on|y  when  the  program  has  some 
a  Priori  Knowledge  about  the  context  °f  the  scene. 


6,4  OCCLUSION 

Occlusion  in  a  scene  may  arise  in  jwo  ways.  The. more 
'ami  liar  cas9  is  *">ere  one  object  hides  a  Portion  of  mother,  as 
seen  from  tne  oo]nt  of  view  of  the  camera.  The  other,  case  is 
where  the  shadow  of  cne  object  falls  on  another  object,  These 
tho  cases  are  manifestations  of  the  same  phenomenons  when  the 
scene  Is  viewed  from  the  point  of  view  of  the  laser  deflection 
assembly,  tne  two  cases  reverse. 

The  deDtn  Discontinuity  edges  drawn  for  body  sfgaratlon 
(Section  6,3)  may  be  used  to  Identify  edges  that  arise  from 
occlusion  from  the  camera,  Repeating  the  procedure,  where  the 
Tar  takes  the  laser  point  of  view,  will  identify  the  laser's 
occlusion  edges,  figure  6,3  shows  a  narrow  cone  In  front  of  a 
snake-  like  object,  In  front  of  a  wide  cono,  Figure  6,4  show*  the 
saTe  scene,  viewed  from  the  laser,  The  duality  between  types  of 
occlusion  edges  should  De  apparent  from  these  two  views.  Where 
two  contiguous  areas  (In  either  view)  ar*  separated  py  a  depth 
o I scort I nu I ty  edge,  that  edge  is  labelled  an  occlusion  edge  on 
the  object  farther  from  the  point  of  view, 

where  occlusion  eojas  are  oeroend I cu  I  ar  to  the  axis  of  an 
cbJect,  as  where  the  tto  of  the  cone  nldes  a  portion  of  the  snake 
>n  Figure  6,3,  the  pieces  may  be  Joined  by  looking  for  the 
continuation  of  an  axis  segment  on  the  other  side  of  the  nldlno 
piece,  A  more  difficult  case  to  cover  Is  where  the  occluding 
ec»e  Is  parallel  to  the  axis  of  the  oody  we  are  examining,  Such 
Is  the  case  where  the  snake  hides  part  of  tne  wide  cone  In 
rlflures  6,3  and  6,4,  in  a  contexj  of  circular  cross  sections,  we 
might  estimate  tne  radii  of  curvature  of  the  visible  oortlons  of 
th«  *  I  de  cone,  apd  unite  the  two  portions  on  that  basis,  In  a 
sufficiently  limited  context,  other  forms  of  surface  fitting  may 
w  c  f  k  , 


In  general,  dealing  with  occlusion  is  extremely  difficult. 
But  the  use  of  three-dimensional  Information  gives  us  some 
additional  tools  for  dealing  with  the  oroolem, 


97 


6,5  PECOGNITIOM  OF  OBJECTS 


\( 


A  test  of  t n (?  effectiveness  of  our  desarlDtlon 
be  to  put  the  descriptions  to  use  in  recognition, 
comparing  our  generated  descf i ot I ong  against  stored 


xSfs 

desc 


oacam  wilt 


Idvq 

riot 


of  th#  objects  among  which  we  are  to  choose  for  identification, 


ve* 

on* 


The  non-un I oueness  of  our  representation,  a3  wo  I  I  as  errors 
to  be  expected  in  the  desorlotion,  make  it  un|tka|v  tnat  the 
generated  description  of  any  object  will  9xaotly  natch  Its 
corresponding  stored  description,  This  means  it  will  be 
necessary  to  develop  measures  of  similarity  between  desc* i ot ions , 


If  the  number  of  oosslble  Identifications  .is  small, 
similarity  might  be  measured  by  spec  I  a  I “purpose  subroutines,  The 
recognition  phase  of  our  oregram  would  then  Involve  calling  the 
<  subroutine  cor resoond | ng  to  each  possible  response,  and  reporting 

which  subroutine  cjave  the  best  dearee  of  match.  But  as  the 
number  of  oosslble  objects  Increases,  this  becomes  inefficient. 

Classification  of  skeletons  based  on  their  topological  and 
(eometrlc  oropertTes  will  do  much  to  reduce  the  search  soaee,  Ms 
*ust  not  place  too  much  rellanoe  an  the  classification  of  Joints 
lade  by  th9  description  program,  The  same  articulated  Joint,  in 
ilffirent  attitudes#  might  look  like  a  T-Joint  one„  time,  a 
tlfurcatlon  another,  and  an  unclassified  Joint  Joining  three 
tke|eton  segments  a  third  time,  The  topological  classification 
Tust  oepand  only  on  the  number  of  sagmants  at  each  joint,  and  not 
any  designation  0f  hierarchical  organization  or  orincloal  axe* 
for  any  part,  While  this  classification  will  not  always  give  the 
correct  answer  the  first  time,  searching  under  similar 

classifications  for  matches  should  find  the  rlmt  match  for  a 
given  descrlotlon, 

(  Another  tochntaue.  for  recognition  Is  a  decision  tree, 

fpeclflc  Properties  of  a  description  are  tested  for,  and  tho 
results  determjn#  further  testing  until  a  terminal  node  is 
reached.  Proper  deslfln  of  the  tree  can  result  In  efficient 

Testing,  put  construction  of  the  tree  Is  tedious,  especially  for 

i  large  class  of  objects,  Where  parts  of  the  Generated 

,  fescrlotlon  ar*  liable  to  be  lncorreot  op  even  missing,  multiple 

raths  must  lead  to  the  same  terminal  node, 


1 


100 


« 


L 


i*. 


/ 

/ 


7  CONCLUSIONS 

.  i?e  have  seen  how  representat  I  on  by  generalized  cy  |  |  ode  r  a  ,  ■nay 
rro^el  many  complex  curved  objects,  we  nave  seen  now  a  practical 
description  program  can  Isolate  the  carts  of  objects  and  describe 
them  In  tarn's  of  generalized  cylinders.  We  have  also  seen  som* 
examples  not  well  handled  by  our  representation,  and  some 
examples  where  our  description  program  breaks  down, 

Regardless  of  Its  shortcomings#  we. feel  that  the  performance 
we  have  demonstrated  proves  the  feasibility  of  the  method,  with 
Improvements  along  the  lines  of  the  suggestions  In  Chapter  6#  It 
has  the  potential  as  the  nucleus  of  a  powerful  vision  system. 


7.1  advantages  or  active  Ranging 

Ths  presence,  and  availability  of  depth  information  to  a 
cescrlntlon  program  Increases  Its  capability  immensely.  Our 
experimental  work  on  description  of  curved  objects  would  not  be 
possible  without  deoth  Information  from  which  to  form  models. 
Shi  r  ®  i  and  Suwa  [Shlral3  report  they  are  able  to  descrlpe  the 
class  of  right  prisms  using  a  ranging  system  essentially  similar 
to  ouPs,  and  some  rather  slmol#  Plane-recognizing  routines. 

Incorporation  of  depth  Information  Into  the  Stanford  Hand-Eye 
system  could  speed  low-level  processing  and  provide  additional 
Information  for  higher  level  routines.  Work  Is  Presently  under 
way  to  provide  a  one-oe  1  nfat-a-t I m»  ranging  capability#  using 
e|thep  the  leser  tr I anflu 1  at  1  on  system  or  stereo  corralatlon#  to 
disambiguate  between  alternative  representations  at  the  highest 
lev#',  Figure  7,i  shows  what  might  be  accomplished  if  dent* 
Information  were  used  at  a  lower  level,  To  generate  this  'isu.-:, 
the  seoond-ordep  curve  fitting  was  disabled  In  the  curve  fitter, 
f-r.o  on|y  straight  I’nes  w§re  fjt,  The  recursive  segmented 
locates  the  cornefs  of  the  objects  very  well,  mure  '.‘J  plot- 
only  the  end  points  of  each  straight  line  segment.  This  cc"nare; 
rath*»r  favorably  wfth  output  fro"  conventional  two-d  i  ne~s  I  ana  • 
eoae  fo I  lowers. 

A  drawback  to  tne  present  system  of  ranging  is  the  long  time 
It  takos  to  seen  a  scene.  For  each  iaser  scan  the  TV  camera  nun* 
ce  r®ad  and  the  l  In#  detected#  and  It  may  take  anywhere  from  Z  ■' 
to  several  hundred  scams  to  cover  an  entire  scene,  9ut  nor- 
sooh  l  st  1  cated  hardware  can  reduce  the  data  acquisition  t  :,e  pv# 
ore  Or  two  ord®rs  of  magnitude,  A  coded  grid  of  r*e  s**' 
-entloned  In  the  last  paragraph  of  Section  3,2  would  rnaL:-e  on.» 
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7.1 


ore  exposure  of  the  Tv  camera  to  v I  ©  ^  a  sc?ne#  out  would  reauire 
some  fairly  sophisticated  processing  to  decode  the  arid. 

In  the  future,  direct  racing  schemes  such  as,  tjma-rf  flight 
TeasUrement  nay  Provide  a  full  aecth  grid  In  as  little  ti.ie  as  it. 
ta^es  to  read  the  TV  camera,  These  would  also  eliminate  tne 
drawback  of  the  Present  metnod,  that  Dianes  and  surfaces  visible 
to  the  camera  but  occluded  from  the  las*r  cannot  oe  setected. 
Another  posslole  technlaue  might  be  stereo  television  with 
hardware  correlation  of  Images. 

we  do  not  DrOoPse  the  Immediate  application  of  any , present  1 v 
available  ranging  devices  to  replace  existing  two-d i mens i ona I 
♦echnleues,  6ut  we  predict  that  active  ranging  will  be  utilized 
•Tore  and  more  in  vision  research  In  the  near  future,  Active 
ranging  will  sceeo  the  day  when  visual  capabilities  are  feasible 
In  Practical  robots,  The  additional  capabilities  provided  by 
aeoth  Information  make  these  predictions  virtual  certainties, 


7,2  WHERE  DO  CO  FROM  HERE? 

w«  are  at  the  verge  of  a  new  eooch  In  the  science  ?f  ccmout®r 
vision,  The  rec«rt  Interest  I*  curved  objects  is  only  a  part  of 
tnls  pew  era,  There  are  many  clans  for  research  and  development 
of  practical  robots  for  industrial  and  extraterrestrial 
aoo I  I  cat  I ons,  and  vision  Is  sure  to  oe  a  major  contrlouter  to  the 
n«w  technology, 

To  exploit  the  full  capabilities  of  vision  I n < genera  I -guroose 
Intelligent  machines,  much  res«arcn  must  D«  done  in  the  areas  of 
lir.age  acquisition,  object  description,  and  representation  tneory. 

The  advantages  of  active  ranging  nave  been  discussed  in  the 
orevlous  Section,  as  well  as  some  possible  candidates  for  fast 
and  accurate  three-dimensional  Inase  aegu i s I  * i on , 

Methods  of  description  from  actual  data  of  primitives  and 
objects  can  benefit  from  Innovation,  Axes  are  frecusntlv 
suggested  by  the  direction  of  minimum  curvature  of  visible 
surfaces,  but  sensitivity  of  this  method  to  noise  in  tn9  data 
Tust  be  considered,  outlines  of  objects  may  be  constructed  from 
tne  depth  discontinuities  In  a  scene  (see  Section  6,3),  we  have 
made  no  attempt  to  utilize  tnese  outlines  In  dotecting  cylinders, 
exceot  In  the  Preliminary  axis  determination,  Tnese  outlines  are 
of  obvious  value  In  guiding  s  primitive  detector  or  nigner-levai 
object  recognizer,  And  very  Mttie  work  has  yet  been  done  in 
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detailed  strategies  for  a  hypothes I s^ver  I  f y  naradlan,  or  for 
r«oo9nlt>on. 

The  representation  w  e  propose  and  use  throughput  this 
research  has  bean  selected  and  developed  with  the  Idea  of  general 
utMIty  In  mind,  The  representat  I  on  we  believe’  to  be  useful  in 
*eco9nl2lns  and  dealing  with  everyday  objects*  But  our  Ideas  of 
utility  are  based  mRlnly  on  mental  exercises,  we  asked,  "If  we 
ware  to  write  a  program  to  reoogntze  hand  tools,  what  kinds  of 
Information  would  be  useful?"  The  final  test  of  our  efforts  will 
be  the  application  of  our  representation  and  methods  In  a 
Dr»ctlcal  robot,  We  have  formed  a  hypothesl s  about  how  to  deal 
w|tn  the  visual  problems  to  oe  encountered  by  robotsj 
verification  of  this  hypothesis  Is  yet  to  be  performed,  When  the 
loop  Is  closed,  a  truly  Practical  system  of  representat  I  cr.  and 
description  can  evolve, 

The  first  practical  robots  w!||  deal  with  a  limited  universe. 
The  reoresentat Ions  they  use  w||j  probably  model  adeauately  the 
objects  with  which  they  are  to  deal,  but  not  have  wlce 
applicability  outside  their  limited  areas,  Nonetheless,  they 
will  provide  valuable  experience,  A  Central  representation 
theory  must  dea|  with  all  the  objects  handled  by  thtse  special 
Purpose  systems, 

There  Is  a  need,  too,  to  understand  the  requirements  of  a 
representation  In  the  related  areas  of  Craphlcs  and  man-machine 
communications,  progress  has  been  made  Independently  in  these 
areas,  but  as  the  capabilities  of  Intelligent  mach I nes i "prove , 
there  will  b •  a  need  to  unify  the  representations  they  use. 
Exoerlence,  again,  fs  the  key, 

The  next  decade  will  see  great Jstr i des  In  the  utilization  pf 
Intelligent  machines,  We  are  oroud  to  have  been  a  part  of  their 
deve I ooment. 
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APPENDIX  A;  ERROR  ANALYSIS  OF  RANGING  SVST£" 

T"0  assumptions  were  mace  In  Section  3.4  whlcn  wi  i  !  affect 
tre  accuracy  of  ranging,  These  wares 

1#  That  the  area  on  the  surface  of  the  rotating  m'rrO' 
through  which  all  laser  Dianes  Dass  nay  be  approx Tmatad  oy  a 
nclnt#  and 


2,  That  the  undlver9ed  laser  bean  Is  reflected  .from  the 
rotating  mirror  at  riant  angles  to  the  axis  of  rotation  of 
the  mirror. 


The  validity  of  th*sa  assumpt ! ons  will  oapend  cn  the  m!tiai 
al'gnrrent  of  the  laser  deflection  assembly  with  th«  laser  oein. 


For  convenience  |r  exposition#  let  u$  denote  t**e  ,  a 
which  passes  through  the  cylindrical  lens  in  a  straight  l 
"principal  ray"  of  the  laser  plane,  The  principal  rav 
the  same  oath  the  laser  oeam  would  follow  If  the  cyllndr!c 
were  rot  credent, 


•jer  rav 
'ne  th* 

foil ows 
r.  I  len« 


If  the  orjnc|Da|  r?.y  strikes  the  rotating  mirror  at  its 
center  of  rotation#  then  all  planes  of  light  must  pass  through 
the  point  where  It  strikes.  If  the  orlnclcal  ray  mlsse3  thn 
center  of  rotation#  then  the  size  of  the  area  through  wh.lo-'  all 
b|ane5  of  light  must  pass  Is  dependent  on  how  close  te  the 
*lrror's  axis  the  Principal  ray  strikes,  on  the  angle  the  mirror 
rakes  with  the  bean,  and  on  the  angle  through  which  tre  mirror 
will  rotate,  Figure  A.i  Illustrates  the  geometry  of  the 
s I tu»t I  on, 


Call  the  distance  from  the  principal  ray  to  the  center  of  the 
T I r r°r  A#  and  the  angle  made  by  the  Principal  ray  and  the  mirror 
l|n  Its  ’’centered"  position)  0,  Suppose  the  "“i  r  rsr.r.c  me  i  !..• 
rotates  over  an  apg|e  of  $»  and  let  us  compute  the  apparent  slz* 
of  of  tha  area  In  Question,  the  distance  R  measured  carafe!  to 
the  reflected  prlnc|o|e  ray  In  the  "centered"  position, 

The  misalignment  A  Is  certnln|y  net  more  than  0.2  Inches;  let 
us  call  It  3,2,  and  s«e  how  much  error  It  introduces,  Typical 
•’aiues  for  0  and  $  are  f-P  dmrees  and  5  degrees#  respect  5  ve  I  y , 
Simple  trigonometry  taking  into  account  that  the  cr.s  i  e  c# 
reflection  of  the  principal  ray  Is  eoual  to  the  angle  c 1 
incidence)  glves  a  value  of  2, 015  Inch  for  the  distance  P, 
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Tne  plane  of  | t gh t  passes  through  a  point  wnlch  nay  be  as  far 
as  5/2,  or  0,0075  lnch#5  away  fpom  whepe  the  ealibration 
Information  things  It  Is,  Figure  A, 2  shows  how  to  calculate  the 
range  error  from  t^s  uncertainty,  X  marks  a  point  on  the  laser 
Plane  whose  depth  Is  known  from  the  calibration  pattern,  v.t  wish 
to  know  the  depth  of  some  ether  point  In  the  seen*  located  a 
distance  D  away  from  X,  The  distance  fpom  the  laser  center  to 
the  Point  X  Is  typically  aoout  24  inches,  The  scenes  we  scan  are 
usually  not  more  than  6  Inches  deep,  so  the  distance  D  Is  not 
more  than  three  Inches,  Solution  of  similar  triangles  gives  e 
distance  of  0,001  Inch  for  the  error,  C»  In  the  posltlor  of  the 
Plane,  This  must  b«  divided  by  the  tangent  of  the  30  degree 
anR|e  between  the  Principal  ray  and  the  line  to  the  camera, 
C I v  1  r*g  an  error  of  about  2,022  Inches, 

-  -Ih5,epC0r  ^caused  by  the  reflected  principal  ray.  not  belna 
oerpondlculer  to  the  ax<3  of  rotation  of  the  mirror  Is  somewhat 

larger,  with  the  magnitude  of  the  angles  involved,  the 
Predominant  effect  of  non-o«roend I cu I ar I ty  will  be  a  deviation 
frcn  straightness  of  the  locus  of  the  principal  ray  across  the 
table  as  the  mirror  rotates,  The  Initial  alignment  procedure 
guarantees  that  the  laser  beam  w| I |  be  within  e,3  degrees  of 
being  perpendicular  to  the  mirror  surface,  (The  cylindrical  lens 
arc  focussing  lens  are  removed,  then  the  mirror  ls‘  rotated  and 
the  deflection  assembly  positioned  so  that  the  bea*  Is  reflected 
p*ck  Into  the  laser.)  The  mounting  of  the  mirror  te  the  moto? 
shaft  Is  to  usual  mechanical  tolerances,  and  should  not  be 
oriented  at  an  ancle  of  more  than  0,5  degrees  to  Its  exis.  We 
she|l  assume  an  anoular  deviation  of  one  degree, 


The  principal  ray  will  sweto 
m|rr°r  rotates.  This  oone  w||i 
hyperbola,  *«  shown  In  Figure  A, 3, 
the  o*v|atlon  from  linearity  will 
laser  planes  are  oriented  at  ±  45 

•rror  In  their  Position  will  o*  0, 
linearity*  or  0,019  Inches,  This  we 
anal*  between  the  laser  ray  and  the 
an  error  In  depth  of  0,337  Inches, 


out  a  cone  In  space  as, the 
Intersect  the  tabletoo  In  * 
Over  a  baseline  of  12, Inches, 
oe  0,026  tnohes,  Since  the 
degrees  to  the  baseline,  the 
707  time*  the  deviation  from 
divide  by  the  tangent  of  the 
line  to  the  camera,  to  obtain 


Thar*  are  som*  othar  known  sources  of  error  .  In  th$ 
calibration,  Errors  In  measuring  the  Intersections  of  the  laser 
scans  on  the  table  top  In  the  calibration  Pattern  are  about  3,020 
Inoh,  This*  too,  must  be  divided  oy  the  tangent  of  the  angle 
cetween  the  laser  and  the  camera,  to  yield  a  depth  error  of  3,010 
Inch,  other  errors  In  the  camera  calibration  are  Probably  less 
tnan  one  raster  unit*  and  may  be  Included  In  the  0.035  to  3,070 


t 


APPENDIX  a:  error  analysis  of  ranging  system 


Flour*  A, 2 

Error  In  Oooth  Duo  to  Motion  of  lastr  C*nt*r 


APPENDIX  A l  ERROR  ANALYSIS  OF  RANGING  SYSTEM 


Locus  of  principal  ray  if  reflected 
perpendicular  to  axis  of  rotation 


Locus  of  principal  ray 
(Vertical  scale  exaggerated.) 


Figure  3 

Error  due  to  Non-Perpendlcularlty  of  Laser  Ray 

tr.ch  figure  given  1n  Section  3.?  as  the  error  due  to  resolution 
lr.  the  TV  catrera, 

Each  of  the  errors  mentioned  her®  are  maximum  errors,  Adding 
them  together  gives  a  total  maximum  absolute  error  In  range  of 
2,?94  to  0,129  Inch,  or  about  a  t'nth  of  an  Inch,  But  to  obtain 
the  average  expected  error  of  any  depth  measurement,  the 
Individual  errors  must  be  divided  by  the  souare  root  of  two,  and 
they  must  be  added  In  root-sum-sauare  fashion,  By  this 
reckoning,  the  average  absolute  range  error  is  2,245  inch  to 
2,056  Inch,  or  about  1/22  Inch, 
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APdENOIX  8 5  CURVE  FITTING 


We  represent  t"o  dimensional  curves  oy  eouatio's  o*  ?h°  fop"’ 

J  k 

G  ( x  <  y )  =  2  2  c  X  y  a  •/,  CEaua*  i  :n  3.1: 

J  k  jK 

Curve  fjttlno  Is  the  process  of  determining  a  set  of  values  f  o  - 
the  coefficients  C  which  minimize  the  mean  sauar  e  error, 

Jk 


2 

E  5  J  <G(x  .  y  ))  /  N» 

i  I  i 


CEaua *•  I  o*i  3.2Z 


over  some  set  of 
constraints, 


data  DoHts  (x  ,  y  >,  1  < 
I  I 


<  N»  under  cert**- 


That  constraints  are  required  should  be  obvious  from  t‘'6  forr 
ct  the  funotlon  G<x.y).  If  each  of  the  C  's  are  zero.  3(x,y> 

IJ 

wiU  be  everywhere  Identically  zero,  and  the  minimum  L  w'll  ^ 0 
aiso  zero, 


Tne  constraint  we  have  chosen  to  use  is  the  "average 
Sr*dl«nt"  constraint  described  In  Section  9,i,  One  of  the 
cr'ncjpal  advantages  of  thjs  method  Is  tnat  the  result  of  the 
minimization  Process  is  Independent  of  the  coordinate  system,  a 
result  whfoh  we  snail  show  In  Section  8,4.  We  know  of  no  other 
constraint  or  set  of  constraints  on  the  coefficients  which 
Dosses*  this  property, 

A  Problem  with  our  method  of  curve  flttin?  Is  a  pendency  to 
Pr°duce  curves  which  "curl  In"  at  the  ends.  An  analysis  of  th;s 
Phenomenon  Is  contained  In  section  B.5, 


B.l  fitting  of  general  second-order  curves 


a  general  second-order  curve  is  represented  by  the  equation 
2  2 

C(K.y)  =  A  x  R  x  y  «•  C  y  +  D  x  +  E  y  +  F  =  3 

Ctpuatio-  : , 3 ' 
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FITTING  OF  GENERAL  SECOND-ORDER  CURVES 


Th*  solutions  to  this  equation  fop  fixed  coefficients  A  through  F 
ars  the  conic  sections.  Finding  the  “Best  fit"  of  this  eouetlon 
to  a  set  of  data  oolnts  <x^»  y^)  Is  eoulvalent  to  minimizing  the 

2 

error  measure  E  =  2  G<x  >y^>  over  the  coefficients  a*  D»  C»  D, 
E,  and  F, 


The  eppor 
reopesentatlcn 

X  * 


measure  E  may  be  concisely  represented  In  matrix 
Define  the  vectors  V  and  X  as 


x  x 
x  y 

y  y 

X 

y 

1 


and 


A 

B 

C 

D 

E 

F 


[Equation  3.4] 
and 

[Equation  3,5] 


Th*n 

T  T 

G(X,y)  a  v  X  3  X  V 

2  T  T 
G  *  V  X  X  V 

2  ^  T  T  T  T 

E=JG  s$V  XX  VaV  2  (X  X  >  V 

T 

E  *  V  P  V 
T 

V 


CEauatlon  3.6] 
[Equation  9.7] 
[Eauatlon  9.8] 
[Equation  B.9] 


where  P  =  X 


Is  a  matrix  of  sums  of  cowers  of  x  and  y. 


FITTING  OF  GENERAL  SECWD-ORDEP  CURVES 


B.l 


Th®  coefficients  which  so®clfy  th®  "Dost  Ht"  ®r®  contained 

T 

In  th®  v®ctor  V  which  minimizes  V  P  V,  Clearly  a  constraint  Is 
needed.  For  I f  V  Is  th®  zero  vector  then  Gtx,y)  will  be 

®v®rywh®r#  Identically  zero. 

Before  choosing  a  constraint#  let  us  asK  what  It  Is  we  really 
w|sn  to  minimize.  Certainly  there  are  constraints  which  will 
y|e|d  e  low  value  of  the  error  measure#  which  we  could  not  accent 
intuitively  as  a  good  fit#  The  Intuitive  Judflment  of  goodness  of 
f | t  depends  on  th®  distance  of  the  data  points  from  the  line 
which  approximates  than,  This  suggests  we  search  for  a 

constraint  which  will  cause  the  error  function  G(x,y>  to  be 
Proportional  to  the  distance  from  the  point  (x^,y^)  to  the  line 

G(x,y>*0, 

To  a  first  approximation#  the  distance  from  the  point  to  the 

line  t«  th®  valu®  of  Glx,y>  divided  by  the  gradient  of  G#  VG#  In 

the  neighborhood  of  the  point,  Ideally#  w#  should  wish  to 

2  .  , 
minimize  2  1  G  /  IVG|  )  ,  However  we  can  approximate  this  by 

constraining  the  aver»ge  or  root-mean-sauare  gradient  of  G  to  be 

2 

unity  over  the  s®t  of  data  points#  and  minimizing  J  G  under  that 


constraint, 
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9.1 


Tha 

magnitude  of 

the  gradient  of  Gi  7G* 

Is  tha  sQuera  root  of 

T 

2  T 

2 

(  V  x 

)  *  (  V  X 

>  i  where 

X 

y 

2x 

0 

y 

X 

CEauatlon  e,103 

X  s  0 

and  X  »  2y 

and 

X  1 

y  0 

CEauatlon  0.113 

Z 

1 

0 

0 

ap«  tha 

derivatives 

of  X  with  rasoact  to  x 

and 

y.  rasoact Ive |y. 

Than 

2  T 

2  T  2  T 

T 

T 

<7G)  =  (V  X 

)  *  <V  X  >  a  V  (X 

X  ♦ 

X  X  )  v 

x  y  x 

X 

y  y 

CEauatlon  0.123 

2 

T  T  T 

T 

2<VG>  « 

v  2<x  x  ♦  x  x>v 

*  V 

Q  V. 

xx  y  y 

CEauatlon  8,133 

where  0  ■  (X  XT  *  X  XT)  Is  tnother  matrix  of  sums  *nd  Dowers  of 
xx  y  y 

x  and  y,  Requiring  the  root-mean-sauar a  gradient  of  G  to  ba 


unltv  Is  equivalent  to  requiring  that  V  Q  V  *  N,  whepe  N  is  the 
number  of  data  oolnts. 


T 

We  wlfh  to  minimize  the  matrix  orodUot  V  P  V,  under  the 
constraint  that  V*  0  V  *  N,  It  Is  w#|!  Known  from  laGfang* 
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FITTING  OF  GENERAL  SECOND-ORDER  CURVES 


B.i 


multiplier  theory  CCourant'J  that  the  constrained  nirfnu-  Is  a 

solution  to  tne  generalized  eigenvalue  equation 

P  V  =  X  Q  V  CEdURt I  on  3.1^3 


for  some  value  of  X, 


The  solution  of  this  eouatlon  Is  descrloed  In  Section  B.2, 
Each  of  the  five  eigenvectors  found  are  normalized  to  make 

Q  V  -  N,  The  mean  square  error  of  each  solution  is  eoual  to 
I^s  correspond  I  no  eigenvalue*  sine* 


2G 

m  •  i 

N 


2 


T 

V  P  V 


=  X 


CEauat^on  R.15D 


B  2  SOLUTION  OF  THE  GENERALIZED 
EIGENVALUE  EQUATION 


To  Implement  the  method  of  Appendix  B.I  requires  solution  of 

the  generalized  eigenvalue  equation 

P  V  *  X  0  V  ,  CEquatlon  3.163 

However*  the  matrix  Q  Is  singular  and  the  matrix  P  Is  nearly 
singular*  the  c|oser  the  data  points  ar«  to  lying  on  a  conic 
section  curve,  the  closer  P  Is  to  being  singular.  He  are 
Indebted  to  Mr.  Richard  Underwood  for  supplying  the  following 
numerical  method  for  solving  the  eouatlon. 
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EIGENVALUE  EQUATION 


I 


a. 2 


The  last  row  and  the  last  column  of  the  matrix  Q  are  zero. 
The  matrix  Q  may  be  reoresented  by  the  partitioned  matrix 


Q 


[Equation  B.173 


4 

w#  may  usually  expect  the  flve-by-flve  matrix  Q  to  be  positive 
definite,  A  Cho|e»ky  decomposition  will  factor  Q  Into  a  lower 


diagonal  matrix  L,  and  Its  transpose#  L  «  so  that 


I 

*  I 

T  LIB 

Q  «  L  L  *  I 

0  I  0 


I 

*T  I 
L  I  a 
I 


a  I  a 

[Equation  6.183 


If  we  t«t  C  r«Dr-s*nt  the  au9ment«d  matrix 


L  ! 

L  «  1 

1  0 

1 

f 

[Equation  9,193 

0 

1 

1  1 

then  we  have  the  result 

.-1  _-T 

L  Q  L  * 

I 

0 

9 

[Equation  9,203 

0  I 

1  0 

/ 
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EIGENVALUE  EQUATION  8.2 

„-T 

whepe  I  denotes  the  fjve-Dy-f{ve  unit  natrlx.  (The  notation  L 

.-1 

oenotes  the  tranSDOse  of  L  ). 


The  original  generalized  eigenvalue  equation,  Eauatlon  3,16, 


"•ay  he  transformed  Into 

.-1  _-T  .-1  .-1  „-T  _-l 

L  p  L  LVSLQL  L  XV, 

CEauatlon  0,213 


ApDiying  tne  substitution 

I 

* -1  „-T  C'  I  U 

C  =  [  P  L  =  I  CEauatlon  0.223 


T  I 
J  I  « 


and  letting  Y  be  the  partitioned  column  vector 


.-1  i 

Y  *  l  vs~- 

w 


yields  the  representation 


CEauatlon  3.233 

% 


I 

C'  1  U  Z 

I  «  X 

T  I 

U  I  a  W 


110  Z 

I 

•  ••• 

i 

0  I  0  w 

CEauatlon  0.243 


This  rray  be  factofed  Into  the  two  eigenvalue  equations 

C'  2  +  V  w  s  \2  CEauatlon  E.253 


EIGENVALUE  EQUATION 


* 


T 

V  Z  +  *  W  3  0  •  CEaUgt  i  on  5,26!] 

Solution  of  Equation  B.26  yields 

W  s  -  (VT  2)  /  or  CEou»t1on  3.273 

which  when  substituted  Into  Equation  B.23  9lves  the  form 

(C'  -  V  VT  /  «)  2  =  X  H  ,  [Equation  5.283 


€ 


« 


Eauatlon  8.28  may  be  solved  by  usual  eigenvalue  methods#  such 
as  the  Q-R  algorithm  ClsaacsonJ,  The  five  original  eigenvectors 
of  EQuat I  on  3,16  nay  be  recovered  by  applying  Eauatlon  B.27  and 
E0uatlon  B.23, 


9.3  FITTING  OF  STRAIGHT  LINES 

The  fitting  of  straight  lines  follows  the  same  procedure  as 
the  fitting  of  curved  lines.  Section  B.i, 


A  straight  line  Is  represented  by  the  eauatlon 


i  <  x .  y )  s  A  x  >  3  y  +  C  s  0,  CEauatlo-.  :,293 


defining 


V  =  B 
C 


and 


X  =  y 
1 


[Equation  r-.333 
ano 

[Equation 


gives 


G(x,y) 


T  T 

V  X  =  X  V 


[Equation  n,323 
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R 


■* 

I  *• 


2 

T 

T 

T 

T 

T 

l  G  = 

l  V 

XXVs 

v  2  (X 

X  )  V 

=  V  P  V, 

CEouatlon  ?.33 3 

w  h  ®  r  ® 

2 

2x 

Jxy 

2x 

T 

2 

P  s 

l  X 

>» 

X 

•M 

II 

X 

2y 

Jy 

CEauj-tlon  =.343 

2x 

Jy 

N 

?  2 

The  gradient 

of  G 1 

VG»  Is  the 

square 

root  of 

A  +  R  for  a  1 | 

x  and  y.  Thus 

2 

T 

10  0 

T 

<VG)  = 

V 

0  10 

V  * 

V  a 

V 

0  0  0 


CEauetlon  9.353 


2 

The  constrained  minimum  2G  subject  to  the  constraint  ?G  :  i 
Is  a  solution  to  the  generalized  eigenvalue  equation 

P  V  =  X  Q  V  [Equation  3.363 

for  some  value  of  X,  Using  the  method  of  Section  S.2,  this 
equation  may  be  solved  symbolically  with  the  following  results. 
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2 


Let 

r  s 

2 

}x  - 

<2x) 

N 

[Equation  9,373 

S  s 

Sxy  - 

Jx  Jy 

•••fiaai 

N 

[Equation  3,383 

and  t  = 

2 

2y  - 

2 

<2x) 

**  -  • 

N 

[Equation  B , 393 

Then 

the  eigenvalues 

become 

X  *  ( r  * 

t  *  C  (r 

2  2  1/2 
-  t)  +  4  s  3 

)  /  2, 

[Equation  9,423 

And 

the  eigenvectors 

are  given 

by 

V 

«• 

s  5* 

-s 

r  -  X 

-  <r  -  X>  2y 

[Equation  9,413 

8,4  ROTATIONAL,  TRANSLATIONAL#  AND 
SCALING  INVARIANCE  OF  EIGENVECTOR  SOLUTION 

^i8 J*ct}onw  2*  shall  show  that  the,  results  .of  curve 
fltt'ng  by  the  method  of  Section  B,1  are  Independent  of  tne 
coordinate  system  In  which  fittinfl  takas  place,  provided  the 
coordinate  system  Is  an  orthogonal  one, 


r.thi?  8B»r.u:hi«siT. ,l,s„nu!trS?„nt,iod?s.? 

than  the  average  gradient,  A  representation  of  general  second 
order  curves  commonly  used  In  curve  fitting  Is 


?  2 

G(x»y)  sax  +  B  x  y  ♦  C  y  +Dx+Ey+l*0, 

[Equation  8,423 

!*'§,  ,*?  oqu I v a l ent  to  Equation  1  of  Section  B,l  with  the 
coefficient  F  aqua!  to  unity,  The  minimization  of  this  function 
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8.4 


Is  frequently  treated  In  college  calculus  courses*  and  Involves 
solution  of  a  set  of  five  simultaneous  l)near  equatlons,  tfe 
observe  that  G<0,0)  Is  Identically  II  hence  the  curve  cannot  Dass 
through  the  origin  of  coordinates?  If  some  of  the  data  ooir.ts 
naopep  to  Me  near  the  origin,  the  resulting  curve  will  oe 
Sr°ss|y  different  from  what  might  be  expected  otherwise, 


Uslno  the  notation  of  Section  R,l,  suppose  that  for  a  set  of 

oata  points  there  exists  a  vector  V  and  a  scalar  X  sucn  that 

T  T  T 

2  x  x  v  =  \  JE<x  x  +  x  x)v. 

xx  y  y 

CEauatlon  3.433 

Let  there  be  some  u-v  coordinate  system  related  to  the  x-y 
coordinate  system  by  the  transf Ormat I  on  Ch3,  such  that 


u 

X 

a  b 

C  x 

v  = 

Ch3 

y 

s 

d  • 

f  y 

• 

CEauatlon  3,443 

1 

l 

0  0 

i  l 

may  derive  fpom 

the  above 

i  that 

u  u  aa 

2ab 

bb 

2ac 

2bc 

cc 

X  X 

u  v  ad 

ae+bd 

be 

af*cd 

bf*ce 

cf 

x  y 

s  v  v  s  dd 

2de 

ee 

2df 

2ef 

ff 

»  y  y 

u  0 

0 

0 

a 

b 

c 

X 

V  0 

0 

0 

d 

e 

f 

y 

1  0 

0 

0 

0 

0 

1 

1 

CEauatlon  3,453 


U  *  H  X  CEauatlon  ?,463 

where  h  |$  an  expanded  transformation  matrix  relating  y  and  X, 

Let  L  ,  and  U  be  the  derivatives  of  U  with  resDect  to  u  and  v, 
u  v 


respectively,  If  w#  can  show  that  there  exists  a  vector  V'  and  a 
sca|ar  x'  such  that  for  all  x  and  y, 
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d,4 


T  T 

V  X  =  V'  Ui  CEauatlon  3.473 

anfl  such  that 


„  T  T 

T 

2  u  u  *  x'  l  <u  j 

+  U  U  )  V' » 

u  u 

V  V 

CEouatTon  9.483 

than  Invariance  w{th  coordinate  system 

will  have  been  proven, 

The  derivatives  of  U  with  respect 

to  x  and  y  are  evaluated  as 

f o 1 1 ows, 

2aax  +  2aby  +  2ac 

2adx  +  (ae+bd)y  +  af  *  cd 

U  s 

2ddx  2dey  +  2df 

X 

a 

d 

0 

2a  (ax+by+c) 

2au 

a  (dx*ey+fj  *  d  <ax+by*c> 

av  ♦  du 

9 

2d  (dx+ey+f) 

■  2dv 

a 

a 

d 

d 

0 

0 

X 

a  U  +  d  U 

CEauatlon  0.493 

u  V 

S|m||*P|y, 

2abx  +  2bby  *  2bc 

<ae*bd)x  ♦  2bey  +  of  *  ce 

U  a 

2dex  ♦  2eey  +  2ef 

*  b  U  ♦  e  u  , 

y 

b 

u  v 

e 

CEauatlon  8,503 

0 
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B.4 


In  addition,  we  shall  need  the  result  that  Tor  C h 3  to  be  an 
orthogonal  transf ormat  I  on  reaulras  that 

2  2  2  2 

a  +  b  =  d  +  e  CEauatlo*  B.51] 

and  ad  +  be  s  0,  CEauatlon  B.52] 


We  are  now  oreoared  to  Drove  the  main  result  by  deriving 
Equations  3  and  4,  The  only  V'  which  will  satisfy  Equation  B.47 


1  s 

-T 

V'  a  H  V 

CEauatlon 

3,53] 

or 

T 

V  e  H  V' 

CEauatlon 

3,54] 

Suostltutlng  th<j  above 

In  Equation  8,43  gives 

T  T 

T  T  T 

T 

2  X  X  H  v'  *  X  5  (X  X  H  V'  ♦  X  X  M  V')  *  7. 

xx  y  y 

CEauatlon  3,55] 

We  oremultloly  by  h  to  get 

.  T  T  .  T  T  T  T 

2  W  X  X  H  V'*x2<HX  X  H  V '  ♦  H  X  X  H  V'  )  s  0 , 

xx  y  y 

CEauatlon  3,56] 

01 Tferentlatlng  Equation  B,46  ‘-'ith  respect  to  x,  or  y  yields 

U  s  h  x  and  U  *  H  X 

xx  y  y 

CEauations  8,57  and  3,58] 

which  we  use  to  w^lte 
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3,4 


INVARIANCE  OF  EIGENVECTOR  SOLUTION 


T  T  T 

J  u  U  v'  u  s  (U  U  V'  ♦  IJ  U  V'  >  5  0 

xx  y  y 

CEauatlon  3,593 

T  T  T 

or  2UU  V'+X2<U  U  +  U  U  )  V'  =  3, 

xx  y  y 

CEauatlon  3.603 

NqWi  by  Equations  8,49#  B.50#  8,51#  and  B,52»  we  may  write 

T  T  2  T  T  T 

UU+UU  saUU+adUU+adUU 

xxyy  uu  uv  Vu 

2  T  2  T  T 

+  dUU+bUU+b«UU 
v  v  u  u  u  v 


T  2  T 
+  h  e  U  U  *  e  U  U 


Y  U 


v  v 


2  2  T  2  2  7 

s  (a  *  b  )  U  U  +  <d  *•  )  U  U 

u  U  V  V 

T  T 

*  (a  d  ♦  b  e)  cu  U  ♦  U  U  ) 
U  V  V  u 

2  2  T  T 

=  (-  *  b  >  U  +  U  U  )• 

a  u  u  v  v 


CEquatlon  B.613 


Sybstltutlna  the  above  Into  Equation  B,60  9lv§s 

T  2  2  T  T 

2  U  U  v'  +  X  (a  ♦  b  )  l  (g  ij  *  U  U  >  V'  *  0, 

U  J  V  V 

CEauatlon  8,623 


2  2 

whlob  Is  Equation  B,48>  with  X'  *  X  (a  ♦  b  ), 
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B.5  THE  CURVATURE  PROBLEM 

There  Is  a  tendancy  for  our  curve  fitter  to  fit  to  the  data 
curves  which  are  very  much  more  flattened  than  we  would  like  to 
see,  Figure  4,13  shows  some  examples  of  this  type  of  "error", 
especially  the  uDo«r  right,  middle  left,  and. lower  left  curves  in 
the  Illustration,  The  curve  flttlnfl  subroutines  check  for  this 
k|nd  of  error,  an  l  reject  curves  where  the  elongation  is 
obviously  too  great,  But  the  tendency  to  fit  flattened  ellipses 
affects  all  curves,  and  Introduces  an  undesirable  amount  of 
systematic  error  Into  the  fitted  data, 

The  problem  1$  accentuated  by  the  fact  that  we  are  dealina 
"|th  on|y  portions  of  ellipses  {or  hyperbolas).  With  a  given 
short  arc,  a  large  number  of  curves  may  be  construed  to  fit, 
When  dealing  with  comolete  ellipses,  ths  principal  dimensions  of 
th.e  curves  necessary  to  fit  them  are  Immediately  aooarent,  and 
only  minor  variations  In  the  fit  could  be  considered  reasonable, 

,  we  shall  show  that  this  tendenoy  arises  from  the  fact. that. 
a|i  other  things  being  eauai*  the  error  of  a  distribution  or 
points  about  a  curve  depends  Inversely  on  the  magnitude  of  the 
second  derivative  of  the  error  function,  That  Is,  a  curve  whose 
Or*dlent  varies  raoldly  tends  to  “fit"  better.  In  the  least, 
souares  sense,  than  one  with  a  constant  gradient, 

The  problem  Is  not  limited  to  fitting  with  the  average 
gradient  constraint,  Lyle  Smith  CSmlthj  noted  the  same 
Phenomenon,  fitting  curves  with  the  constant  term,  F,  of  Eouation 
3,3  constrained  to  unity,  We  believe,  but  have  been  unable  to 
orove,  that  no  linear  or  quadratic  constraint  on  the  coefficients 
of  Equation  B,3  can  eliminate  the  Problem, 

An  Illustration  will  make  olear  the  dependence  of  the  average 
error  measure  on  the  derivative  of  the  (magnitude  of  the) 
Or»dlent,  SuoDose  that  In  the  x«y  Diane  there  exist  .n  points 
uniformly  distributed  near  the  y-axls  between  the  limits  x  *  -1 
ap.d  x  *  i,  as  shown  in  Figure  B,l,  A  one-d Imensl ona I  error 
f unct  I  on 


F  ( x )  *ax  *BX  +  C  CEauatlon  g,63] 

g|v#s  the  error  of  each  oolnt,  The  average  error  measure 

n  2 

G*J(F(x>)  /n  CEauatlon?, 643 

I  I 
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B , 5  the:  CURVATURE  problem 


1 s  to  bs  minimi j»d  ovsr  ths  distribution  of  points,  Ws  may 
sporoxtmsts  ths  «rrof  msasur*  F  by  an  ln+»0ral: 


-  12  2 
G  *  /  (ax  *  B  x  +  C>  dx, 

-1 

Ths  avsrags  flpsdlsnt  constraint  r«aulr«s  that 
11  dF  2 

•••  /  (  mmmm  )  (j  X  3  1 

2  -1  dx 


CEouatlon  B»653 


CEouatlon  B.663 


°r 


1  2  ,22 
/  <2  A  x  +  B)  dx  s  8/3  a  ♦  2  B  »  2, 

•1 

CEauatlon  R.673 

,  .  Ths  oaramsjsr  A  must  not  b«  fl£0»tsr ,  tban.ths  sauars  root  of 
3/4  In  ordsr  that  this  constraint  os  satlsfTabia, 
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THL  CURVATURE  FRODLEM 


The  second  derivative  of  Fix),  (which  in  the  two  dimensional 
case  „ould  be  the  derlvatlv*  of  th®  magnitude  of  the  gradient  of 
F)»  Is  Drooortionai  to  A,  For  Illustrative  ourDOsts,  we  mav 
choose  aroltrary  values  for  A ,  subject  to  the  limitation  above, 
solve  for  8  In  Equation  P,67»  then  find  the  v&iue  for  C  whlcw 

ir|n|rr|zes  the  error  measure  G, 

2 

Figure  g,2  slots  F<x)  and  F(x)  against  x  for  three  different 
values  of  (This  olot  would  require  three  dimensions  in  the 
two  o | iriens I ona I  case,)  The  Integrals  of  the  shaded  areas  under 

2 

the  curves  for  Fix)  are  G«  the  error  measure,  The  minlrum  error 
occurs  when  a  1$  eaual  to  the  square  root  of  3/4, 

Elongated  elljcses#  and  hyoerbo|as  whose  asymptotes  cross  at 
narrow  angUs,  are  characterized  by  a  high  derivative  of  the 
TaSnituqe  of  the  gradient  of  thalr  defining  function,  jhe  curve 
f|tter  chooses  these  flattened  curves  over  the  more  intuitive 
curves  we  would  Prefer, 

A  possible  solution  to  the  problem  involves  a  wejchted  least 
saUares  approach  and  an  Iterative  method,  Lyle  Smith  used  a 
Tethoc  In  which,  after  solving  the  least  sauares  eauation  to  flnp 
an  ellipse,  he  wguld  weight  each  point  by  the  curvature  o*  the 
ellipse  near  that  coint,  After  several  iterations,  t*e  method 
converged  to  the  intuitive  solution,  But  our  attempts  to  apolv 
this  method  to  our  average  gradient  solution  failed.  It  was 
difficult  to  distinguish  among  the  five  eigenvectors  to  determine 
which  one  to  use  In  determining  the  weights.  Perhaps  a  smaller 
weighting,  so  that  the  solutions  varied  slowly  with  each 
Iteration,  mlgnt  have  given  acceptable  results,  but  this  was  not 
tried, 
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8,6  ALTERNATIVES  TO  GENERAL  SECOND-ORDER  CURVES 


Curve  fltt'n9  oy  general  second-order  curves  leaves  much  to 
fee  desired,  Solution  of  the  least  sauares  ecuations  reajlres 
nruch  computation.  Choosing  among  the  three  solutions  returned  is 
tricky,  A  practical  solution  to  the  end-curlln3  problem  was  not 
been  found,  The  parameters  of  the  curve  are  not  easy  to 
manipulate,  Re  discuss  In  this  Section  some  alternatives  to 
9enera I  seconO’or d#r  curves  which  mlnimlze  some  or  all  0f  *h®se 
croblens» 


we  are  committed  to  general  second  order  curves  njjniy  for 
historical  reasons,  The  curve  fitting  routines  were  originally 
written  for  an  attemot  to  datact  cylinders*  cones*  and  sDhares  in 
conventional  TV  Images  Orocessed  by  an  edge  finder*  much  in  the 
sa"*e  way  cubes  are  detected  in  the  present  Stanford  Hand-Eye 
system  [Feldman],  in  such  an  application,  It  was  important  that 
ellipses  be  represented  simply.  In  the  present  application, 
flescrlptlon  of  three-dimensional  curved  objects,  what  we  reculre 
mainly  Is  an  efficient  smoothing  operation,  and  a  representation 
capable  of  carrying  curvature  Information,  But  at  this  oclnt  in 
time,  the  parameters  and  data  structures  of  goneral  second  order 
curves  are  so  firmly  embedded  In  our  programs  that  it  woula  take 
several  weeks  to  convert  to  another  reoresentat ion. 

Nevertheless*  we  suggest  some  alternatives. 

The  easiest  tvoe  of  function  to  compute  woujd  be  Quadratic 
polynomials.  For  each  segment,  we  draw  a  baseline  between  the 
endpoints,  and  rotate  the  segment  50  that  the  transformed 
baseline  Is  the  x.axls  of  the  new  coordinate  system,  ThTs  method 
would  tend  to  Isolate  segments  of  uniform  curvature,  because  a 
segment  may  have  uniform  curvature  when  viewed  perpendicularly  in 
3-space,  but  not  aopear  uniform  when  viewed  In  Dersoective  from 
the  Tv  camera,  it  would  be  advisable  when  using  this  method  to 
transform  the  ooints  to  three  dimensions  before  curve  fitting, 

The  data  structure  for  Quadratic  polynomials  would,  need  to 
contain  orly  the  coordinates  of  the  two  end  ooints,  and  the  three 

2 

coefficients  A,  B,  and  C  of  the  function  y  =  A  x  +  b  x  ♦  C, 
Since  the  coordinates  of  the  end  points  untauely  determine  the 
rotation  of  tne  Points,  there  would  be  no  need  to  seoarately 
Include  It, 

A  version  of  the  ourve  fitting  orogram  using  puadratic 
oolynomlals  has  been  Implemented,  and  seems  to  give  somewhat  more 
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alternatives 


consistent  results  than  fitting  t>y  general  seconu-orcer  curves. 
flSur®  B.3  s'10ws  t*®  t°r us  as  It  with  auaorat'C  polynomials. 
Compare  tnis  with  Figure  5.15,  Fitting  Is  in  TV  rastef 
coordinates  In  thl?  version.  Some  further  imorovement  might 
doss  1 1 1 y  Oe  expected  were  conversion  to  three  dimensions  to  take 
D|ace  before  curve  fitting. 


,  Quadratic  so  I Ines  are  very  much  like  quadrat 
w 1 1  h  an  additional  stipulation  that  tne  end 
functions  representing  each  segment  must  coincide. 


c  polynomials, 
DOmts  of  the 


A  spline  Is  a  function  defined  on  an  interval  divided  uo  into 
a  finite  number  of  sub  1 nterva I s,  yhe  end  points  and  the  points 
where  two  subintefva|s  join  are  cal  led  nodes.  For  an  n-th  order 
spl!ne,  the  function  on  each  suolnterval  Is  an  n-th  order 
Polynomial,  Usually  the  function  Is  constrained  to  be 
continuous*  and  continuous  In  Its  n-i  derivatives,  at  Its  nodes, 
but  other  constraints  are  sometimes  applied,  The  spline 
functions  which  we  su99«st  are  second-order*  and  continuous  in 
zero-th  derivatlva  (the  function  Itself  must  be  continuous,) 

If  we  draw  a  baseline  between  the  end  points  of  the  line  and 
rotate  the  curve  so  that  the  transformed  baseline  Is  the  x-axls 
of  the  new  coordinate  system,  we  may  fit  the  line  with  such  8 
spline.  For  a  given  olacenent  of  the  nodes,  the  function  F  (x> 


which  minimizes  the  mean  sauare  error  J(F(x)-x  )  may  be  found  as 

I 

the  solution  to  a  (2n+l)th  order  System  of  linear  eouatlons, 
whtre  n  Is  the  number  of  sub  I nterva I s , 


Instead  of  recursive  segmentation,  we  need  a  procedure  to 
systoirat'ca  I  |y  introduce  nodes  until  an  acceotabls  fit  Is 
obtained.  Introducing  new  nodes  at  the  points  where  the 
Dolntwise  error  Is  greatest,  and  perturoing  the  nodes  to  Improve 
the  overall  fit,  In  a  manner  similar  to  the  method  of  DeBcor  and 
Rice  [OeBoorD,  may  give  good  results,  but  many  details  remain  to 
be  worked  out.  Some  car9  must  be  taken  not  to  let  nodes  lie  too 
close  together,  to  Drevent  obtaining  functions  which  osciilate 
wildly.  Some  means  of  distinguishing  between  straight  lines  and 
curves  should  b«  looked  Into,  since  straight  lines  may  not  be 
f I tt®0  separately  from  quadratics. 


I 

I 
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FI gur •  B , 3 

Torus  Fit  With  Parabolas 
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